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Executive Summary 



This report describes a three-year study of the use con- 
sulting to improve teaching among faculty members at the 
University of California , Be r ke 1 ey . The method used was to 
obtain ideas from excellent teachers a^Wt What they did 
that led students to rate them high on any of thirty ques- 
tions about particular facets of their teaching (e.g.. Gives 
lectures thart are easy to outline; Encourages class discus^ 
sion; Knows whether the class is understanding him/her). 
These ^deas were then passed along to other faculty teachers 
who had been rited lo,w on the same items by students in one 
of their classes. Selected ideas were described to these 
faculty in a teaching improvement consultation just before 
the next time they taught the same course. Ideas they 
expressed interest in were then discussed with them in some 
detail^ The faculty members themselves made the decision 
about whether they would use a particular idea in the next' 
offering of the course. 



Towards, the end of the secohd offering of the course, rat- 
ings by the new group of students were obtained on the san>e' 
thirty item questionnaire. Ratings before and after the. 
consultation on the items for whi'trh 10 or more faculty had 
been given ideas showed statistically important ^positive 
change. / 

Ratings of overall teaching effectiveness were also com- ' 
pared. Qf th^ 49 courses for which we had complete data, 24 
showed significant positive change, 13 showed no* change, and 
9 showed negative changje. 



Beginning faculty members continue to need help in learning 
how to teach. It is clear that the teaching consultation 
process does help faculty gain knowledge of alternative ways 
to teach- It "^also provides the structured opportunity for 
faculty members ^,to take time from their busy schedules to 
spend on improving their teaching. L / 
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USING CONSULTATION TO' IMPROVE TEACHING 



Most beginning Berkeley faculty members^ like beginning faculty 
members at any university^ are in the early stages of- learning 
teach. In the procesls^ ti;ey often have questions about how to^ 
handle some aspects of teaching^ e.g. "One of my sfudents^ repea 
^edly as-ks questions that disrupt -the class. How can I'stop him 
without putting him down?" * 

It is usually difficult for faculty to .get ideas gbout ways to 
handle* such teaching' problems . Heysb^ is usually reticent abcilt 
asking a colleague or the department chairperson. It's hard to 
ask people for help In an area as central as teaching ^ particu- 
larly when they will be involved in later decisions about your 

career. ^ 

• / 

Evidence of effective teaching is a part of the documentation 
needed for promotion at the^ Universi ty of California. In. 1969^ 
President Charles Hitph issued a revised "Instructions to V 
Appointment an'd Promotion Committees" requi r ing the submission 
evaluations of 'the candidate's teaching including evaluation's b 
students (^pendix L)i. 

^President Hitch's instructions and related statements led to ia^ 
c^rie^ of efforts by the University directed towards improving' 
teaching and instruction. ] In 1970 the Regents of the Universit 

of California. establishe*d a fund to be used f oi^instructional 

. # . . /■ ■ . 

improvement projects on the nine campuses. In 1972 a $1^000,.{JO 

line item for improving undergraduate instruction was added to 



the University's budget by the state legislature. 



Also, in 1972 tlie , Berkel^ campus of . the Universi^tjy establish 
the office of ^T^aclnng Innovation and Evaluation Services (TI 
The ^rpdses* pf that of f ice are to assist* faculty members, 
"departments tfnd schools in their effojts t^ innovate, evaluat 
and impro^ve instruction. » " ■ ' ^ 

.In the^summer of 197,9, Lynn Wood, Barbara Davis and^ I (1) dec 
to .make an active effort* to give diri^ct help to faculty in 
improving thei r . teaching . We chose^ as .our procedure a consul 
tion process that gave faculty members good ideas ^out those 
aspects of their teaching on which students gave them "-lower r 
ingsi ^ " ^ 

r 

The consultation idea was borrowed from a study done by Keith 
Jacoby (I9.76.) at, the School of Pharmacy, - University of Sari Fr 
.ctsco. Jacoby administered 25 of the teaching. evaluation ite 
^.developed by Hildebrand, Wilson and^Dienst (1971) to students 
the classes of eight pharmacy teachers. Six week&. prior to t 
next time the p'^armacy professor taught l^he course Jacoby hel 
half^fvou^ consultation with four faculty. He f^>und s.ignifica 
improvement for those faculty conisulted with* and no impr«\;reme 
for the control group. 

* ' . ^ ■ - ■ V • ' 

■ T 

We decided to build upon .the i-dea of -consulting with faculty 



1 Lynn Wood was Assistant Director of T.IES. ' Barbara 
Davis 'W&s Assistant "Research Psychologist at TIE^. 
"Robert Wilson was Research Psychologist and Directorwof 
TIES. • ^ 



they might learn about new things they, ct)uld dq in their teach^ 
ing* In considering the essential requirements for a successfiA 
consultation process we^ decided that: . • 

1. The help should be easily .accepted by Berkeley faculty 
members. y 

2. The help should be easily, put into practice by fac^ulty. 

3. The help-should be easily given by the consult^ints. 

The preceding requirements have shaped the form that the Teachin 
Evaluation Consultation Servi<fe (TECS) has takeij, that is: 

1. The help should be easi ly accepted by Berkeley faculty member 
has me^nt: 

• Participation in TECS is voluntary (i.e.r the decision to 
participate or not is made by the faculty member). 

• Ideas for good teaching are derived mainly from .colleagues 
rather than the professional educational literature. 

e ' 

The decisions about which ideas to put into practice are 
made by the faculty client. . ^ • ^ 

• The consultant is not in a "line" r.elationship to the 
faculty member's advancement. ^ 

• The initial development of the service has been done by 
emphasizing that Berkeley faculty mefmbers are assist inc|^ us 
with 6ur research into the consultation process. 

• Participation in this consultation process is treated as 
confidential . - ^ . 

2. The help should be easi ly put into practice by faculty has 
meant : , 

) \ ■ 

• Emphasis on short concrete ideas that are definite enough 

' that faculty members can easily adapt them to a particular 
class. • . 

.# 'Consultations are "tailor made** to .each faculty member's 
teaching evaluation print-out. 



• Several ideas are briefly "run by" a faculty client. 

• A smaller number of these ideas ar^ discusse.d in detail. 

The help should be easily given- by th^ feonsultants 

• * 

• ,The consultant should not have a personal stake in .a 

faculty client's acceptance of a particular idea. ^ 

^ It 5hould not be necessary " for the consultant to be expe 
in a client's field.* ^ 

• The consultant must be clear that the decision to use. an 
idea is the faculty member's. 

• There must be no condescending or patronizing element in 
the offer to help. , ^ 
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I. METHODS 

The material which follows reports the results of a three-year 
research study designed to' determine whether the oopi^ultation 
process led to outcomes that documented its effectiveness in 
helping faculty improve their teaching. Ninety-six faculty 
members participated as client^; The results iTeported are for 4 

faculty teaching 46 cour^.es for wKich we had complete before and 

• . • ^ . . / 

after teaching evaluation data. ' , 

A. Getting the ideas from excellent teachers 

Wood, Davis' and I wanted to get a set of idieas- of good things 

for a faculty member to* do in his/her teaching that would als 

. be keye<? to improving specific aspects of teaching. To accbm 

plish' this, we invited two samples of acknowledged excellene 

teachers on the Berkeley campus to h^Xfr us with our study 

(Apptendix A). The two samples^^cluded former recipients of 

the campus's Distinqiiished Teaching Award still teaching on 

the campus,, a^s^liie 11 as faculty members who received multiple 

nominations in a survey of gjraduating seniors in the spring o 

, 1978 in response to the questions: 

"Please ..ame the one faculty member who was the best 
teacher you had at .Berkeley." 

and / ' • 

Name the one faculty meinber from whom you learne'd the mos 
during your studies at Berkeley. (This may or may not'te 
the faculty member who was the best teacher.)" 
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ParenthetLcaiiy r we were grati-.fied to find that .most of the 
■•'■.! • ■ ' ' ' ' 

former Distinguished Teaching Award recipients who had expo- • 

sure to I undergraduates wete included a{nong the faculty nom- 

' 1 . . , \- • ' . 

iriated k^y seniors. . 

As requested in the letter of invitation^ members of the 

excellent teacher, sample agreed to our administering an end- 

* ■ * ■.' . * 

of-course questionnaire to students/in pne of their classes. 

They also filled out a questionnaire rating their own percep- 
tions -of )thei r teaching . # ^ 

The Student Description of > Teaching quest ionnai rj^- ,(Appehdix B) 
asks students to describe 30 aspects of the teaching in'^ par- 
ticular class using a 5 point scale with 1 meaning "Not at all 
Descriptive" -and 5 me^rniixg ''Very Dfescriptive"'. In addition, . 




it asks f^r ratings of the over^Tl>«4fectiveness of the teach- 
ing and the woi;thwhileness .of the courseT""^^ also includes 
open-ended -questions asking for details of the st reltg^hs^an^ 
weaknesses ©f the course, the teaching and' suggestions fo"r 
change. . 

The Student Descriptiory of Teaching questionnaire was adapted 



from- one 'developed in a threei-year study of the' qualTties that 
make teaching ex^cel lent conducted for the "Davis campus of the 
University of California (Hildebrand , M. , Wilsoa^ R.C. , & 
Dienst, E.R.rl971). Items were drawn from each of the fiVe 
factors identifiecJ in that study and other items were included 
that discriminated between excell^ent and poor teachers in an 
. item-analysis study. . • 



The 'fi^e, tiachin^ factors rej^resented include: Organization 
and Clarity ; Aftalysis / Synthes is ; Teacher - Stpdent Interaction ; 
Teacher - Group Interaction ; and Dynamism / Enthusiasm . 

Organization / Clarity is defined by such items as:. Explains v 
clearly; Identifies v^at he/she considers important. 

Ana lysis j^ Syn thesis includes such items as: Discusses points of 
view other than his/her own; Contrasts implications pf various 
theories . 

Teacher - Student Interaction is defined by items such as: Is . 
accessible to students out of class; Has genuine interest iiv. 
students. v , - . 

■ « 

Teacher - Group Interaction is defined by items such as:. 
Encourages class discuss ion; Knows if the class is understand- 
ing him/her or not. ^ ^ 

Dypam ism / Enthusiasm is defined by items such as: Is enthusias- 
tic about his/her subject; Has an interesting style of, presen- 
tation. * . 



A deliberate effort was made to include a diversity of iteiirf^ 
so that the questionnaire would include statements. that are 
relevant to' a diversity of types (lecture, discussion, labora- 
tory and studio), sizes (large, medium and small), and levels 
of classes (lower division, upper division and graduate) . 

V 

The stjbdent questionnaire was administered in either the first 
or l^st fifteen minutes of a class meeting during the ninth or 
tenth week of 'a ten week term. The questionnaire was admin- 
istered; by the consultants themselves. 

Faculty members whose classes were being used were asked to 
leave the class while the student questionnaire was being 
administered. .They were also asked to fill^out a Faculty 
Self - Descr iption of Teaching questionnaire (Appendix E). This 



questionnaire consisted 'Of the saru^-oS items iaclucjed on the 



student questionnaire except phrased in the first pe^soo^ 
(e.g., ••In teaching ^this course/l: Discuss points of view \^ 
other than my own" ^rather than ^In teaching th'is- co'urse 
he/she: Discusses points of view other than his/h^r own" ) . 
The faculty questionnaire also asks about how m'any times the 
faculty member has taugnt the course cjnd other information 
about the course. , 

After the end of the term. an .appointment was made for an 
interview with each excellent teacher . Thirty-nine excellent 
teachers were interviewed. The .interviews focussed on the 6-8 
iJteras-T that students rated as most descriptive of the faculty 
member's teaching. 

The question asked of faculty was "Can you think of anything 
you do that would lead students to say that it is very 
descriptive of your teaching that you-: (the item stem was 
inserted here;. e.g.. Explain clearly; Encourage .class discus- 
sionj?" ' 

An example of the inte*rview style follows. .An excellent 



teacher in Wysics was^ given^ a mean rati^^ 
scale on item 15; Knows if the class is understanding him / her - 
or not. The ensuing dialogue was something like the follow- 
ing: 

"Can you think o^ anything you do that would lead students to 
say that it is so descriptive of your teaching* that you knpw 
if the class is understanding you?" 



IK 



u (a brief reflective pause) ^ 

"Yes. It's probably because_of my minute papers." 

"What's a minute paper?" • 

"Well, I giv.e my students about a minute to write answers to 
two'questions. Four or five times during the term I come to 
class five minutes early. I write two questions in the corner 
of the boai'd: * 

1) Whatsis the most significant thing you learned today? 

2) What, question is uppermost in your mind at the end of ' 
this class, session? 

Then I go ahead and give a 49 minute presentation. One minutei 
before the b^ll rings I tell the students to take out a piece 
of paper, si^n it, and answer the two questions -in one minute. 
When the bell rings I ask them to pass their papers to ^the 
aisle. I walk down the aisle and pick them up? I ori|^i^ally 
started this\as a meaningful way of* taking attendance and 
would simply give the papers to my reader to. check off the 
names. Later, I started reading the papers and trfaey, of 
course, -do provide excellent feedback oa whether the students 
ar.e understanding and whether theje are important '•quest ions to 
which I should^respond."^^ 

• « ■ * * • 

There are, of 'course, other benefits from u6ing "minute 
papers" : \ - • 

• It requires more active listening from studepts. 

• * ^ * » . . 

• It helps in. identifying students who are inneed of special 
help on who may lack adequate preparation for the course. 

• Our informant alsp tells us that it improves students writ- 
ing. Responses during tjie last weeks of . a class, are ^.onger 
and more articulate than those during the early weeks. 

• Relatedly, this also hielps document for students that they 

_.£H^e--i^^d^e^ — 



16 



. \ 



ERIC 



Giving the ideas to client teachers 

second and experimental phase of the study required: 1) 
recruiting client teachers; 2) developing a cpnsultation pro- 
cess for passing along the good ideas obtained from excellent * 
teachers to client teachers and 3) detetmininc/ whether tl>is 
process was associated^ wi th positi-ve change in teaching* 

1) Recruiting Client Teachers 

^^tlrir-recruiting potential clients, we used several methods to 
publicize the availability of* our new Teaching Evaluation. 



Consultation Service. 




In the Fall of 1979 we met in a series of small two-hour 
seminars- with 30 department dhairpersons to describe the 
proposed service. We asked them to refer faculty from 
their departments who. would be willing to help us test the 
consultation process. In addition, daring 1980-81 we sent 
memos to 120 fa6ulty inviting them to participate in the 
consultation study (Appendix B) • During 1981-82 we were 
particularly interested in learning about the experience of 
— t e acM-ng--3raTg^^-^gesfe^iihan^-^^ i ta tio d & 

were sent to faculty teaching lower division courses. 

Ninety-si1l[ faculty members participated as clients during 
• the period from Fall 1979 to Summer 1982. At the time this 
experimental period was terminated , we had complete before 
and after teaching evaluation data on 45 faculty teaching 



46 courses. The data analysis results are from this sam- 
ple. For the other 51 faculty data were incomplete. 
, Either th-ey were still participating in the service or they 
had terminated before final data^ could be collected. Four- 
teen of the. 45 client faculty wished to continye with an 



additional consultation period. A third set of teaching 
evaluat/ions was gathered at the end of the third off'^ring 
of their course. Further data on. client faculty charac^ 
teri/^tics are presented in Appendix K. 

2) Th4 Teaching Improvement Consultation Process >v 

/' f > , ' . ^ .. . ^ W \ 

I ■' . . * ' ' ■ ■ 

/In our efforts to help faculty members improve their teachr ^ 

ing: . . - 

We administered an end-of-course Student Description of • 
Teaching questionnaire (Appendix D) at^ the end of the 
current offering of one of their courses. (Time 1 assess- 
ment) . / • 

We had the faculty member fill out, at the same time, a 
Faculty, Self - Description " \>f Teaching questionnaire (Appen- 
7 dix E) which includes the same questions Worded in the 

■ ~~ ' ' ' . L„ — . ~-^===^====r- 



first person. \ "■ . 

. ^ ' . ■ ■ * , ■ ■ ■ 

We sent to the faculty member his/her computer printout 

■*'■'■•#• ^ • ■ 

(Appendix F) , student questionnaires and self-description 

• ^ "-—^ * 

• . . - 

questionnaire. The covering letter ^or this mailing. ^ked ^ 

for a preliminary consultc^ti^ .i to be held 2-3 weeks after 

the term ended./ . ' 

V./ I .... 



ERIC 



a) The preliminary consultation 

At the preliminary session (1/2 hour), results of the 
. Student teaching evaluation were discussed brief ly. The 
faculty member was asked about what questi^naire items 
he/she would , like the consultant to find good ideas. 
The faculty member was asked when he/she ^ould be teach-' 
ing the course again and a tentative appointment was 
made for the main consultatipn. 

b) Preparing for the main consultation * r \ 

The m3in^ consultation occurred two tofqkir weeks before 
the next time^ the faculty member taught the same codrse, 
when he/she was preparing for the cburse. In almost all , 
instances this occurred just before the same quarter one 
year later. 

In preparing for this session^ the consultant studied 
the computer printout (Appendix F) which summarized the 
previous teaching evaluation. The consultant picked the 
three highest items and the three to five lowest items 
to be used in the consultation. * C 



The open-ended responses from individual student ques- 
tionnaires were also read for the additional information 
they provided about the strengths and weaknesses of the ' 
client's teaching. , 
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Bearing in mind the discipline, mode of 'course, size and 

■ ^ , .. - • . 

lev^l of course, the consultant next examined the ideas 
^in our ld«a book that were keyed to the particular items 

. * 

on which a client wanted help (Appendix I). 



The ideafe for particular items had'^beel^^ 
ously in interviews with teache^fs^' rated high on 'J:he 
item. Ideas thaju-selmed promising fo'r the particular 
client to use were selected by the consultant. 



c) Conducting the main consultation 



The consultant started by reiftinding the client about the 
nature and purpose of the study. Reference was,, also 
made to the previous feedback session. 



^ 



•To begin the session on a positive note, the clieAjt was 
intervie*i^ed for ideas about his/ her three highest items 
iij the same way that members of the excellent teacher 
sample had been. Ideas that seemed useful were added to 
the idea book« 

/ • . " ■ 

The three to five items that students said were least 
_descrrptive ot the cli ents'' teach ing and in which he/she 
had expressed interest were conside^red one at a time. ^ 
The consultant described to the client the 6-12 possible 
ideas he/she had selected from the idea book for an item 
(Appendix I). The two or three ideas that the client 
expressed most interest in were discussed in fuller 
detail and xerox copies of one-page descriptions of the 

' • ■ • ■ 20- • ■' ■ ■ 



ideas weris left with the client. 

\ ■ ■ ■ • . 

In our consultations, we gradually became aware of cer- 
tain" verb^al "and non-verbal behaviors of faculty. These 
behaviors seemed likely to be related to whether a - 
faculty client would indeed make a change in his/her 
teaching. Our awareness of these cues came too late in 
the study for^us to investigate their predictiveness irt 
a formal Way. We mention them here as hypotheses thatd 

could be inv.e.stigated in future studies. 

> . * . . 

Most of the consultations were' held in the faculty 

merfiber's off ice. Cues that seemed positive* were that 

the faculty clients 

• ;Had notes from the earlier debriefing session on the 

table or nearby * ^ 

• 'Had a draft of a syllabus for the next term's off er- 

ijig of the class and brought it . into the discussion 
during the consultation i 

• Had a draft of the reading list'for the next 'term's 
offering of the class and brought it into the discus 
sion during the consultation 

• Had paper and pencil, for taking notes during the con 
sultation , ' 

• Took notes during the consultation 

-lir^VihWti^^ s ~ o f -nraxng or- a d a p t i ng an -idea 

to the particular class 

• Thanked the 'consultant or in other -ways made it seem 
that the* consultation session had been -stimulating 
and idea-generating 
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d) Follow-up^ letter 

During the next flew days, this consultant wrote? a letter 
summarizing the consultation (Appendijc J). It was sent 
to the Client along with a second, set of the 6rie-page , ; 
^descriptions of selected ideas. It was^ hoped that th^ 
.letter would reinforce adoption or adaptation of some of 
the ide^s and affirm th'e consultant's availability to 
give further help. , . ^ 

e) Friendly phone calls 

During the term following the consultation, the consul- 
tant called the client once or twice to ask "How are 
things going?-" Occasionally the consultant would give 
additional ideas. , ^ - 

f) Other things we did 

For most faculty clients, the debriefing s^gssion, the^ 
. main consultation and the friendly phone calls were a^l 
the help that was given. A few faculty received addi- 
tional consultations or other kinds of help. For exam- 
\ pie, for a few faculty who requested it, we ^id observa- 
tions of their classroom performance and discussed it 
with them afterwards. A few faculty asked us to do mid- 
quarter student evaluations for them. They used these 

as feedback from students about how things were going. 

J I 

This enabled them 'to make changes thaty would benefit 

/ ■ * . 

their current set of students. . , j 



g) Time 2 assessment 

At the end of the second offering of the course the Stu- 

dent Description of Teaching ^ questionnaire was admin- 

* ■ . . • 

istered a ^ecohd time. The^ faculty member also filled 

* out a second version of the Faculty Self - Description of 

Teaching quest ionni?ire:. These provided post-test data« 

h) Time 3 assessment 

As mentioned earlier, 14 of the 45 client faculty wanted 
to continue with an additional consiSltation period. A 
third set of teaching evaluations , was gathered at the 
end .of the third of fering of their course (Time 3). 

Feedback af results to faculty 

The analyses of the resulting data are presented in the 
next section. However, something should bo said about how 
faculty were informed of the results and how decisions were 
made about whether to contin^ie or terminate consultations. 

After the end of the second offering of the course, the 
consultant scheduled a follow-up consultation with the 
faculty member to discuss the results from time one to time 
two. As an aic^ to this^we developed a Change Comparison 
Sheet (Appendix H). ^ - 

At this final consultation the changes in mean ratings that 
had occurred on a^iy of the 30 individual items were c^is- 
cussed.. Where item m^ans changed importantly in either a 
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po s i t i V e ^r- -negiktive -d Ir ectioJV»_.ciien t s . we r e a s k eit_ab.ou t 
their interpretations of the meaning of the changes, 

1 • 

1 

A change was defined as statistically important change if- 
it equaled or exceeded 1/10 of a standard deviation. (Cohen/ 
1977). Changes on thi* overall teaching effectiveness scale 
. were also discussed. * ' • 

The question about whether the faculty member wanted to 
continue with additional consultation or to stop w^s also 
examined* In all but 14 cases, the consultation process 
was discontinued either because^the faculty member was 
. ^ satisfied or because of other reasons (e.g. sabbatical, not 
teaching, the course again, etc.). In 14 cases, the faculty 
client decided that he/she would like to continue with^-^on- 
sultation for another time period, usually because the 
faculty member was dissatisfied with, his/her progress dur- 
ing the first time period. For these ^clients the entire 

1 ... - ■ . ■ 

process was repeated for a second; time period. ^ 

. ■ '.I 
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itudent Description of Fac\ilty ' ; 
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II. RESULTS AND DISCUSSION ^- 



A) Student Description of Fac\ilty ' s Teaching Before CoflsultyBliioh < 

One of the questions we have been asked ^is what leind of v 
faculty teacl]|,er makes use of the consultation service, "Do the 
teachers who re'a lly need help make tise of your service?" A 
partial answer to the question can be seen ^in the frequency 
distributions presented in Table 1 (see next page) ^ 

Students 'were asked to describe the oyerali« teaching effec- * 

tiveness^of their ins-tructor on a 7-poiht scale (1 = Not at 

. ■ . ■ «. 

all effective ... . 7 =«Extremely effective). The frequency 
distribution of ^the mean class ratings is shown in Table 1. 
The mean of the distribution is 5.2 and the distribution is 
skewers With none of the class means being below 3.0. 

The mean of this distribution is comparable to the means of 
student ratings of 'ove*rall teaching ef f ect'lveness found in 
other departments using ^the same item*. The resulting means^^J*^ 
are shown in Table 2 (see page 20). As can be seen the 
results are about the same except for F«rrestry. The depart- 
ment *of Forestry places unusual emphasis oh teaching excel- 
lence. r ^ 
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Table 1 



^ Distributio n of Mean Ratings 
of Overall Tee;chTng Effectiveness 
of Client Faculty 



Mean Ratings 

1.0-1.4 * 
. 1.5-1.3 
2.0-2.4 
2.5-2.9 
3.0-3.4 
' 3.5-3.9 
4.0-4.4 
,4.5-4.9 
5.0-5.4 
5.5-5.9 
6.0-6.4 
6.5-6.9 

Total 

Mean 

Median 

Standard 
Deviation 



N 
0 

of 

0 
0 

1 

2 

3 
1-2 

9 
11 

7 

1 

46.6 
5.2 
5.1 
0.74 



/ 



Percentage 

0 
0 

3 
0 
2 
4 
7 
26 
•20^/ 
24 
15 
2 

100 



26 



/ 
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Table 2 



Mean Overall Teaching Effectiveness Ratings 



pepartment X N 

Business, 5.1 i| 
Administratis 

Soc io l^ y ^5 * 2 ~ 18- 



Optometry 5.3 16 

^Forestry 5.8 9 

TECS Clients ^ 5.2 * 45 

All department data for Spring 1982. 
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B) Changes in Students ' Description of Faculty 's Teaching After 

Consu ltation 

- # 

Differences from Time One ( Tl ) to Time Two ( T2 ) 

r 

We were interested in determining whether giving ideas for 
., ♦ - _ 

improving particular aspects of teaching was associated with 

positive change in student rating^ of a teacher's behavior. 



We gave ideas to teachers for improving on particular items • 
(i.e. Explains clearly. Summarizes major points. Knows when 

students are bored) . - 
♦ 

After the students described the client ' s teaching performance 
at a second time point, a statistical importance test (Coh6n, 
1977) was'' performed on changes in the mean ratings from time 
one to time two. The hypothesis of our study was that there 
should be statistically important improvement from the first 
time the course was taught to the second time on the mean rat- 
ings foj: the items in the Student Description of Teaching fdr 
which ideas were given. 

Results of the tests, for the statistical importance of changes 
froi^i time one to time two tot 46 classes are presented in 
Table 3 (see next page). ^ 

Ts^ble 3 indicates that among the items fop* which suggestions 
were given to at least ten faculty members, sojne resulted^^in a 
l_arge_numhpr of fc^eaj^ty making positive changes. For one item 
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' Xible 3 . 

Statistical Importance of Cha n ges from 
Xlgxr^ne - to Time Two ^ 

Chang 

• ■■ ■• ■ ■ ■ ' ' Total 

. Decrease No Change Increaise Classei 

Explains clearlV. 2 (18%) 3 (271) S!"*! " 

Gives lectures that are easy to outline. 3 (21%) 2 (141) 9 i« 

States objectives for each class session. 1(10%) 9 .,,,; ! 221 i.? 

Encourages class discussion. 5(38%) . 2 151 ■ ,J JJJ 5^ 

Knows if the class understands. « !"I S JSJ ?J JS5 « 

Knows when students are' bored. ^ ?4J .6 281 10 481 21 

Has ah interesting style of presentation. 3 20% J??* 18 

Varies th? speed and tone of his/her voice. 4 (22% 7 391 7 391 18 

Motivates students to do their best work. 2 (18% 3 27% J 5" ii 

Keeps students informed of their progress. 3(30%) 1(10%) 6 (60%V lo 

Uvlress'"' 9(20%) 13(28%) 24 (52%) 46 

/ ■ ■ \ ' ■ ' 

Other items were omitted because fewer than ten clients were given suggestions on those it«w 

itistically important change was considered an increase or decrease in mean score from time oi 

me two of at least 1/10 of a standard deviation. \, 
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only 39 percent -of faculty .showed positive change. For most 
of the items a moderate proportion of falpulty showed positive 

\ 

change. ' ^ ' ' . - 

•. • *■*'"* • • • . ■ / 

Ninety percent of the faculty 'BJartained' changes in the positive 

direction on the item "States- objectives |^): each clas^ ses-^ 

sion." The suggestion for . improving' this itejS^ is self-evident 

in the statement of the item; 



Sixty-five percent of faculty obtained positive 6har\g^s on the 
item "Gives lectures tha't are easy , to outline." The kitids of 

■ ■, ' • ^ • 

suggestions given to faculty to help thfem improve their teach- 
ihg included: • ^ / . V 

"Outline your lecture on the blackboard as it develops." 

"Striictuce a lecture as you would a journal article." 

"Organize your lectujre into 10-minute segments!" 
All of' these suggestions are quite behavioral or concrete. , 
They do not take any spejcial. flair or self-- insight to put into 
practice. This finding and this interpretation suggests that 
the more behavioral, specific *and concrete a suggiestion /is, 
the ^more easily it can b^ linplemented by a teacher ar\id the 
more likely it will be to affect students* perceptions of 
his/hec teaching. 

This interpretatipn i-s somewhat supported by the relatively 
smaller impact on positive change which resulted! from sugges- 

tions given relative\to item #24, "Varies the speed and tone 

>• • .. 

of his/her voice." (Onjy 39% of faculty showed 'positive 
changes. The remaining 61% showed no change or a negative 
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change.) The suggest^ions which were given for improving rat- 

ings on this item Include: 

*" ^ • » ■ ,^ • . 

"Build deliberate and purposeful pauses into your lec^ 
tures." V ^ • 

V "Vary the pitch or inflection of your voicie." 

"Color-code your lecture notes withj^es to^ *slow down,* 
'pause ^and get attention,' 'demonstrate with gestures,' or 
other stage directions." 

^ ^ ^ ' '■ ' ' '' : " 

These suggestions necessitate teachers bein^ able to regard ^ 
their verbal and nonverbal, behavior objectively, and being * 
able to vary it at will«'* These are acting or self- 
presentation skills that some faculty members may hot possess'. 

Four items showed statistically important change for at least 
60%> of the teachers who were given suggestions for th^m. 
these 



Item 8. Gives lectures that are easy to outline. ^ 

■ / . ■ . . ■ ' ^ 

Item 10. States objectives for each class session. 

Item. 22. Has an interesting style of presentation. 

Item 30. Keeps studelnts informed of their ptogress. 

i^' All these items had suggestions which were rather more 
I ; behavioral than the items which did not show positive changes. 
Concrete, specific, behaviorally-based suggestions, then, sefem 
to be the most productive (effective) in assisting faculty 
members to ijnprove their rated teaching effectiveness. 
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This project did not examine, systematically^/ the various ele- 

r 

ments of the consultation process,, so we do not know which of 
its elements are the most important in producing the changes 
we obtained. Although we believe that the qrucial element is 
having access to clearly stated, concrete suggestions relevant 
to. the teaching behavior areas which teachers wish to change, 

— we cannot be c e rtain that this i s the c a se . — It m a y be that 

talking to sympathetic, experienced consultants about your 
/ teaching is the important element, 

* The results from analyses of the statistical importance of 
changes in ratings by students o^f overall teaching effective- 
ness are also presented in "Table 3, Twenty-four of the 46 
■ classes showed statistically important changes in their mean 

overall teaching eff ectiveness , ratings. Thirteen of the 
classes' showed no change and nine showed negative change. 

Differences Between Time One , (Tl ) , Time Two (T2) , and Time 
Three (T3) . 

Fourteen prof essors participated intthe TECS project through 
/ ' ft 

two different consultations: one consultatiph occurred between 

the time one and time two teaching descriptions and a gecond 

~\ ^^consultation occurred between the time two and time three 

descriptions. The Kruskal-Wallis . analysis of rank-order vari- 

ance was used to measure differences in teaching performance 

for the three time points. This procedure was used because it 

allows us to examine the three evaluation scores at Tl, T2, 

and T3 simultaneously which avoids problems with Type 1 errors 
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caused ^by multiple significance testis. The results of this 
analysis are as follows (see Table 4 on* next page): 

FQurt^en of our faculty clients decided to continue partici- 
pating in the study for a secoAd year.. Four (29%) of them had 
received higher ratings from their students but wanted to try 
out additional changes and ideas. Ten (71%) of the fourteen . 
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had showed no. change or negative change in their ratings and 
decided to continue. . ^ 

The impressions received f^om these ten relates to the motiva- 
tion to change and how a person manages to accomplish change. 

> * . . . ' - ^ ' . ■ ■ ■ ' 

The ten had implied a commitment to change by accepting our 

invitation to participate in a research project to "test the 
efficacy of the consultation process and the pool of suggested 
good teaching practices in improving teaching. We had deli- 
berately made the onus on faculty participants as low as pos- 
sible. 

We know from our interviews with members of this group of ten 
that' they wanted to be better teachers. They accepted the 
thought that by learning some good ideas they could become 
better teaphers. Their experience's during their first year of 
the project did not support ^^^^ir expectations. 

During the second year^ from T(2) - t(3), eight (57%) of the 
faculty clients showed a positive increase in the ratings of 

34 



Table 4 



Statistical Importance of Change^ f r< 
' Time One to Tiine Two to Time Three 



rom 



Change 



Item 



rail Teaching 
ectiveness 



Time 



T2-T3 



Total 

Decrease No Change Increase Classe 



3 (21%) 7 (50%) 4 (29%) ' 14 
1 (07%) 5 (36%) 8 (57%) 14 



Note: The contrasts in the table are between the mean on thfe 
student evaluations at one time period against the mean on the 
student evaluations at another time period. The exact procedure 
used is described by . Marascuilo and McSwedney in their 1977 
book , Non Parametric and Distribution - Free . Methods for the 
Social Sciences y p. 299-318. ' 
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overall teaching effectiveness they received from their stu- 
dents* Only one received lower ratings of overall teaching 
effectiveness. / 

It is as though the first year's experience taught some 
faculty clients that know^^g about new things to do was not 
enough. They became more active in trying some of the options 

they had learned about. 

/. * ■ _ • . 

^ • h ' ' ' 

C) The Comparison Group ^ 

It was not seen as feasible . or desirable to assign any of the 
' faculty participants to a non-intervention control group. 

They had responded affirmatively to our invitation to make use 
of a consultation service for helping them improve teaching 
. and we felt obligated to provide that service. We^ decided to 
use, as a Comparison group, another group of faculty members 
who had received only the results of their student ratings. 

We were encouraged in that decision by the evidence from prior 
studies showing thkt in the absence of interventibft, faculty 
members generally show little change in the ratings they 
receive from students about their teaching effectiveness from 
one time to another. 

Rotenvand Glasman (1979) in a review of studies "On the Effec- 
tiveness of Students' Evaluative Feedback to University 
Instructors" concluded that "The main, implication emerging 
"f^m the present review is that feedbadc [..alone..! from stu- 
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dent ratings [as was elicited and presejited to teachers in th 
studies reviewed] does not seem to be ^effective for the^jJur- 

/ . • ■ f 

pose of improving performance of university teachers." 

i' 

Kulik (1977) in an Article on "Students! Reactions to Instruc- 
tion" commented that "Teachers have collected student reac- . 
tions to college co^jjirses' for over 50 years. The traditional 
procedures are familiar to most teachers.- A student rating 
form, usojally consisting o£ 10 to 40 statefments, is given to a 
teacher by a'n administrator for gatherTrig student opinion. 
Each statement of the form describes 9ome characteristic of a 
teacher, and students are asked to indicate the degree to 
which the statements apply to their te^cH^r. After grades are 

turned in, the teacher receives from the administrator copies 

^ ] 

of student response sheets or a clsTss summary indicating the 

f> ' * . . 

percentage of students endorsing each of the it^s. 

"Several studies carried out by the* Center fpr Research on 
Learning and Teaching (CRLT) , University^ of Michigan, research 
scientists .Wilbert McKeachie and^Yi-Guang Lin have sliown that 
this traditional means of collecj^ing student opi.nicyti leads to 
little or no change -in the quality of college teaching. Sbb- , 
sequent teaching by instruct;prs who receive student opinion in 
this way is about the same as the teaching of those who 
receive no feedback." ' - . , . . ^ 

To check whether this was true"^ at\our pwn campus, we undertook 
the following non-intervention study; We analyzed the ^records 

f 

•of student end-of-course ^valuations of teaching in one of the 
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Schools* that for the last ten years has been using the origi- 

" . - ■\ ■ 

nal questionnaire on which :our questionnaire was based (23 of 
the items are identical). 1 

The faculty members used were in the same sitluation as our 

■ \ t • ■ ■ 

I 

faculty clients in that: { 

/ ' * ' ■ . [ I 

1) each time they taught a particular course [it was evaluated 
by students at th^e end of the course; 

• ; • ' . ' 

2) a few weeks latefr they received q computet printout summary 
of results (like those in Appendix F); [ 

3) they also received :the origina^L student questionnaires at 
that tim« including student comments about the strengths 
and weaknesses of the course. 

' ' * "■ , ' 

Two things are different about the comparison sample: 



1) they did npt receive any ideas th.ey might use to improve 

« items on which they^ete rated low, ^ 

2) they did not self-select themselves into the situation of 
agreeing to be helped to improve .their teaching. 

• • • 

For the period Fall/ 1979 through Spring/ 1985, the same • 
period as the TECS study, we selected 101 courses that were » 

* taught twice *by the same faculty member during that time 
period. We compared the mean ratings ^received at time one 
with the mean ratings received from ^ttTdents at time two on 23 

, of the specific items that were the same on the^ two question- 
naires. The resultant changes in mean difference on all 23 
quest4^ns were ^ero ranging from -.06 to +.13 with none of 
them be.ing significant. . 
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We also compared time one (Tl) student ratings with time two 
(T2) student ratings on the overall evaluation question: "Con- 



sidering. both the limitations and possibilities of the subject 
matter and cdurse, how would you rate the overall teaching 
"effectiveness of this instructor ?" The difference in means 
between (Tl - T2) « -.01 yith a standard error of the differ- 
ence of .09. 

Essentially there is no difference without intervention. One 
might conclude that faculty members teftd to teach a course 
pretty much the same way from occasion to occasion as seen by 
students. 
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III. CONCLUSIONS AND INTERPRETATION 



Th6 data reported indicate that: , 

1) The consultation process was associated with statistically 
important change in overall teaching effectiveness ratings fbr 

^ 52. percent of the faculty clients. 

2) Half of the faculty clients showed positive change on 9 of the 
10 items for which suggestions were given to at least. 10 * 
faculty*"^ 

3) The less complex and more' concrete items were the ones on 
which the greatest number of faculty showed statistically 
^important change. 

4) One third of the participants elected to continue in the con- 
sultation study for an e^ditional time period. Approximately 
one third of them showed statistically important change from 
Tl to T2. Over half of them showed change from T2 'I'^* 

5) A group of 101 faculty received the computer profiles of the 
Student Description of Teaching plus the orfginal question- 
naires. They received no suggestions about things they might 
do to improve their t^ching and showed no significant change 
in the ratings of their teaching they received from students 
oh two different occasions. 
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It is interesting to speculate about the factors that may^ have 
ybeen ilfiportant in leading • to'^change in faculty clients', ratings. 

In looking at the processes by which faculty members effect real 
improvement in their teaching^ it is useful to consider two 
aspects of the change process separately: 

.a 

1) One aspect is knowing what to do. Does a faculty member know 
. about other options or ideas? For example^ if a faculty 
ipember is having difficulty in getting stvudent participation 
•i.h class discussion> does the faculty member have knowledge of 
alternatives that would- lead to iiicreased student participa- 
tion; Probably notr unless he/6he is given a chance to gain 
knowledge about alternative ways of doing things. This is one 
.... of the ways in which the TECS project has functioned. It has 
focussed on helping faculty to le\rn additional ways of doina 
things in their teaching - ways that they didn't know about 
before, 

2} A second aspect of change is being able to actually do the 
something different that you have knowledge of. Khowing 
better ways to do things doesn't mean a person will be able to 
do them. Knowing that if you give up smoking you may^ increase 
your life span doesn't make it easy to give up smoking. Know- 
ing that if youdon^t drone you will improve your teaching 
doesp't make it .easy to vary the speed and tone of your voice. 

^ It's this second aspect of change with* which it seems most 
difficult to help faculty. 



It may be, however iSthat interpersonal expectations established 
ill the consultation sessions create for some faculty a desire to' 
fuliill an implied Contract with their consultant. It is cer- 
tainly true that the consulting process sets up a situation for . 
producing change thrat isn't set up by merely sending faculty 
members a book of good ideas along with their Student Description 
of : Teachinq results. Making ai^ appointment and spending an hour 
talking with a teaching consultant about concrete ideas gives 
structure and impetus to a faculty member's taking steps to 
improve teaching. The .fir^t step was taken when the appointment 
was made« . • 

During 1983-84, we have been experimenting with alternative pro- 
cedures for helping faculty learn about good idea% they can use 
in their teaching. We have had a group of* f ive Emeritus Teaching 
Consultants working with ten client faculty using the sjime pro- 
cedures described here. .In addition, we have had five faculty 
who did not receive consultation but did receive a copy of the 
same book of good ideas that the consultants used. <The results 
of this study will be reported in Emeritus Teaching Consultants 
Help ImprovjW Teaching (in preparation) The facultry. members who 
received consultation from the Emeriti showed ^significantly ^ * 
greater improvement in their teaching as rated by students than • 
did faculty members who just received the book of good ideas to 
use by themselves. 
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' TEACHING INNOfVATIOM & EVALUATION SERVICES 
(TIK) 
262 Stephens Hall 



Dear: 

The TIE$ staff Invttes ypu to. taKe advantage of one of its services 
designed to assist faculty members In fmproving Instructlon.^Thls service 
Invdives using student evaluations of teaching as diagnostic, s$1f* 
Improvement tools, linking student ratings on particular questionnaire 
Items with specific, concrete suggestions for improvement. 

Your participation would con&lst In: 

1) Selecting a course which you would like to have evaluated this year. 

2) Permitting tiS. to come Into one of^ your class sessions during the 
eighth through tenth weeks to administer the attached teaching 
evaluation questionnaire to your students (this takes about IS 
minutes). If your course Is especially large,; the questionnaire can 
be administered In a sample of section meetings If you prefer. 
Summary results as well as student comments will be returned to 
you within a f^ weeks • * . 

3) Meeting with one of us to discuss the concrete things you do that, 
may lead students to rate certain questionnaire Items as especially 
descriptive of your teaching, the interview will be scheduled" at 
your convenience after the end of the quarter. 

During the same Interview, we will also relay information on the 
specific things that other teachers do that lead th^ to receive^ 
high ratings on any items.of special Interest to you «{for example, 
what others do Jto "explain clearly". No. 6 on the questionnaire. 

■^ * ; • ■ :v ■ ^ ^ ■ * . . o. 

4) Agreeing to have the course re»eva1uated the next time you teach it ^ f 
, to see if the suggestions you adopt improve your student. ratings on 

relevant questionnaire items. 



jfie began this project in the summer of 1979. To date, close to 100 

UCB faculty members in a wide variety of disctpUnes have participated, 

both contributing and receiving many useful ideas and teaching ^tips. 

We holpe that you will find the project both interesting and worthy of \. 

your participation. ^ . Y • 

Sincerely; • . V 

Robert C. Uilsorr' . Lynn Uood^r . Barbara Gross Davis 

\ ^ ^ ^ -^A ■. 

If you would like to participate, please fill out/the attached form and 
return it to the TIES office, 262 Stephens Hall. If you have any questions 
about the project or would* like to discuss your participation before deciding 
to participate, please give any one of us a call at 642-6392 or 642-1811. 
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Letter of Invitation to Cll€nt Teachers 
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TO: UCB FACULTY 

FROM: ROBERT C. WILSON, DIRECTOR, TIES " 

RE: NEji TEACHING EVALUATION-CONSULTATION SERVICE 

- * 

Beginning, 1979-80, the. TIES staff will be offering a new teaching evaluation 
and consultation service designed to help faculty members make more effective, 
use of student end-of-course evaluations in improving their teaching. This 
new service links the ratings which students give a faculty member on partic- . 
ular questionnaire items with specific, concrete suggestions for improvement. 

' ■ . ■ . * , 

These suggestions are being gathered in a. series of interviews with 100 
f acul ty meiiibers known to be excellent teachers (e.g. , recipients of Disting^ 
uished Teaching Awards). In these interviews., faculty members are being asked 
to describe what they think they do thit leads students to give them high 
'ratings on specific items or variables on a standardized student end-of-course 
evaluation form. , 

Ue would like to invite you to participate in the research phase of this new 
service. We hope to involve faculty members from a variety of disciplines 
who teach courses of various sizes', levels, and types (e.g. , seminars, lec- 
tures, laboratories). 

Your participation would consist of: ° 

1) Selecting oiie course which you would like to have evaluated this Fall, 
Winter, or Spring {juarter. The questionnaire will be administered in the 
9th oV" 10th week of classes and will take. approximately 15 minutes, yhile 
students are filling out their forms (see .yellow attachment), you will be 

•asked to complete a parallel self-evaluation form (see green attachment). 
» Summary jjesults, as well as student comments, w^ll be returned to you with 
, in a few weeks. ' ; . 

2) Consulting with a member of the TIES staff for 30-45 minutes about your 
highest and lowest ratings a week or two before the next time- you' teach the 

• course. During "this meeting, the consultant will "relay" specific suggest 
, ions for improvini] you^f* lowest ratings and/or the items which you have in- 
dicated yo'u would most like to improve. All aspects of the evaluation ahd 
consultation will be kept strictly confidential . 

3) Agreeing to have the course re-evaluated- the next time you teach it to 
see if-'the sugqestioni. you have adopted have helped to improve your studen 
rati-ngs on relevant questionnaire' items. 

The ultimate aim of the project is to test the efficacy of the consultation - 
process and the. pool of suggested good- teaching practices in, improving teaching 
If successful, the consultations will become an ongoing, service of TIES and the 
evaluation form with suggestions keyeSfl to individual items will be incorporated 
.into a handbook for those faculty inembers who would prefer to use them in a sel 
study approach. . , • 

We hope that you will find the project both interesting and worthy of your sar- 
ticipat'ion. 



If. you would like to participate,' pi ease .fill out the attached fom anc return 

it to the TIES office. • . 
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TO: ROBERT C. WILSON^ LYNN WOOD, AND BARBARA DAVIS 

Teaching Innovation and Evaluation Services (TIES) 

262 Stephens 

Campus 

FROM: 



_ ^I am interested in participating in your research project on, 
"the evaluation and improvement of teaching, Fall Quarter. 

• The best time to administer the forms in my class is: 

Date: November ; Day of Week: 

Time: (The first 15 m^inutes of class) 

(The last 15 minutes of class) ^ 

The course is: . - - 

It meets in Room , . H al l . 

The. number of students^enrolled is • - 



I am interested in participating in your project, but the course 
far which I would like to have an evaluation-consultation will be 
taught: . 

W inter Quarter. Please contact me at that time. 

/ Spring Quarter. Please contact me at' that time. 

I. prefer to talk to oneof you before agreeing to participate in 
.the project. The best times to reach me are: " 

Days of week: 

Hours: ^ 

A do not wish to participate in the research project this y&ar. 

J ■ - ■ ' - . 



50 



Appendix D " ' 

Student Oescr-|pt1on of Teaching Questionnaire 

D-1 Typescript version 
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Oepartmnt^ 
Instructor 



Course Number 



Quarter, 19 



I. The following Items reflect some of the ways teachers can be described. For the Instructor 
named above, please circle the number which Indicates the degree to which you feel each Item 
Is descriptive of him or her. ' In some cases, the statement may not apply to this Individual. 
In these cases, check Doesn 't apply or don't know . 

Responses wjll not be returned to the Instructor until after final grades hiive been given. 

Very Doesn*t 
Not at all Descrip- apply or 

Descriptive tlve don't know 



1. Discusses points of view other than his/her own. . 

2. Contrasts Implications of various theories./ 

' 3. Discusses recent developments In the field..,../ 

4. Gives references for more interesting & Involved 

points ; , '.. 

5. Emphasizes conceptual understanding 

6. Explains clearly....;..... 

7. Is, well |)repared. \ 

8. Gives lectuv*.s that are easy to outl ine. . . . . 

9. Summarizes major points 

10. States objectives for each class session 

11. Identifies what he/she considers important 

12 



13. 

14. 
15. 
16. 

17. 
19.' 



Encourages class discussion 

Invites stutlents to share their knowledge and 

experiences ...^ 

Invites criticism of his/her own Ideas 

Knows If the class is undierstdnding him/her or not 

Has students* apply concepts to demonstrate 

understanding i 

Knows when students are bored or confused 

Has genuine Interest In students 1.../. .. 



Gives personal help to istudents having difficulties 
In course 



20. (delates to students as Individuals 

21. Is accessible to students out of cla^ss.. , 

22: Has an interestlng^style of presentation....... 

23. Is enthusiastic about his/her. subject 

24. Varies the speed and tone of his/her voice 

Has Interest in and concern for the quality of 



25. 

26. 
27. 

28. 
29. 
30. 



Ms/htr teaching. 

Motivates students to do their best work 

Gives 1,nt'erest1ng and stimulating assignments... 

Gives examinations requ^rirg synthesis of parts 
of the course 



Gives examinations perrittl'io students to show 
understanding... 

Keeps students Informed of their progress.. — 



2 
2 
2 

2 
2 
2 
2 
2 

2' 

2 
2 

2 
2 
2 

2 
2 
2 

2 
2 
2 
2 
2 
2 

2 
2 
2 



PLEAS 



4.5 


( ) 


4 5 




4 5 




4 5 


. ( ) 


4 5 


( ) 


4 5 


I ) 


4 5 , 




4 5 


( ) 


4 5 


( ) 


4 5 


( ) 


4 5, 


( ) 


4 5 








4 5 




4 5 ; 


( ) 




■ ^ 






4 % 


( ) 


4 '5 


( ) 


4 5 




4 5 




4' 5 




4 - 5 




4 .5 




4, 5 • 




4 3 




4 5 




4 5 




4 5 




4 5 





TURN THE PAGE 



II. 1. .ConslderiM both the.HjnItitlbns *^nd po»;s1b1Mt1es of the subject matter and course, how would you 
rate the Overall teafching effectiveness of this Instructor? 

Not at all Moderately Extremely 

effective effective effective ► 

.1 . • 2 3 4 5^ 6 7 77 

" - ' • ' • • " ,. ' 

.2. Focusing now on the course. content, how wjHrthwhIle was this cours f In comparison with others you 
have Uken at this University? 



Not at all - T v Moderately Extremely 

, worthwhile . • worthwhile wortnwhlle 

1 i \ ^ 3,4 5 6 " 7 78 

III. Are you taking this course because It Is required? 

(1)_ yes (2) . ^ n o 79 

7 • . 

IV. COMMENTS: 

1. Please ust»th1s space to Identify what you perceive as the real strengths and weaknesses of: ^ 
a)* the course ' * . 



b) thi instructor'! teaching 



2. What improvements would you suggest? 



.7 
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STUDENf PESCRIPTION OF TEACMIMO 

)EPARJME^^r■ : \ 'i' ^ -.. . 

NST'RLHCTOR * _ CDURSe-NUMBEP OUAi^-^ER. 19 

rbe.follOAiing items reriecr -oithi of trie way's teachers can be ciescribed. Fcr tf-e ins:- -i; . ,.i;neu ahc-^ , nu.'risf' fill in / 
he numberecl box whicTi if.dicate^ tne degfee to which yoj feel each item is dy:cr;ptiv(- o' ot hor / 

£jrAU..HAyE_.NO ijslFpR PLEASE -'l.-^ iN ThE N/A B_0X.' 

Responses will not be returned to the instructor until after final g ades have bpfTi qAer, ' ~ 

► USE NUMBER 2 PENCIL ' 

► ERASE COMPLETELY TO CHANGE ... ., , — — . '. ^ 





Net Al A . - 
Desc.npt'Ve 


'DeBcriotive 


N/A 




,V^Discusses points view 6ther than his/he'' own 


L- 










tg A) 




• 2. Contrasts impl.cations of various theorrgs. 


c 










18 W 




3. Discusses recent developments m ♦■ie field. 


c 














. 4, Gives references /or more interesting' & involved points. ' ^ . 
















0. ^cmpnAsteesv^onceptUrti unders^an.-^ir.g 


r- 






:4.-> 




» Al 




6. Explains cle«rl)y ^ 


c 










wm 




7. Is well prepared \ 


c I .: 


■■'Z^ 






A3 




8. Gives lectures that a rXeasy. to out! I nfe . . ^ 






Mo 








9 Summarizes rOfJior pomtK 












;l« Aj 




. 10. 'States objectives ♦or each c>a5s session. 










M/A3 


t 


11. IcTefitiftes what he.'she consider^impcrtant ' , 


L.t^ 








U A3. 




-12- Encourages class tfiscussfon. \ • . 


c-.},; 












13 Invites students to share their k^iowledge and experiences 






2 3. 






kl A3 




14. Invites criticism of his/her own .ideas. ; . 


■ J 














15. Knows it The class ir» understanding h;m her or not 






2 ^ 






n: AP 




16. Has students ppply concepts to demonstrate underi^ianding. ^ ' 














17. Knows when "?;tudenls are bcred 














18* Has genuine interest in studenis. . „ \ 






^= 


-it ; 






19. Gives personal help to students hriving difficulties >r coufse ^ 




I 






.. . 


.■^ ^ 




.20, Re<atw. to students as individuals. ^ ^ 


eta 












21 Is accessible to students out ot ciass ' 










^ - 


fC A3 




22. Has an interesting style of presentation. • , 














23 Is enthusiastic abou^ his/ft'er subject 






c3 . 


t:43 




fC .A3 




24 Varies the speed and tone of his/her voice. ^ 




=2= ^3- 


c4= 








25 Has nterest m and concern for the abaiity of his-^ier teaching. 








c4: 




rc A3 




26- Motivates students to do thosr best worlc. 


r. 


[-.■ 


^ 4- 










27 Gives interesting and stimulating assignments • - 


< 1 




c4. 




X AP 




26. Givee eiiaminations Squiring syiiih^sls of p^rts of the course , 












tCAia 




^29. Gives exanf^jnatipns permitting students J^show understanding. 






--■2^' s^'^ 






M A3 




' 30. Keeps students Informed of iheir progress. ' n ^ 




- 


^2- =33. 














1 Consider. r,g botr' rn^-* ;ir»r.!.i!ir-' -v., J poss-bi'it-es 0" tho -^[^n.:t matfpf .I'l;' ^<-^M'>f \\ 












r-xt'emely 
rftV.'Ctive 


^wou'd rate v>vf-rci:! tf-ac^'f.g eftevM'venp:^> t*'•'■^ r-jc • >' ^\ 

" ' \ . ^ 


^ 1 














2. Poci^sirg now on the course content, how Vi'orthwh'Je was fhis course m corrcjnrisof? with 






^^ Extrenwly 
! Worthwhile 


others you have taken at this Un'versry'^ ^ 














' ' ^' . • •-: •■ - : j'.-P. , . - j 




















i 




' i - R "^i ^' 
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COMMENTS: . ' " 

1. Please use this space to identify what you Q^rceive as the real strengths and weakrr^ses of: 
. a) the course ^ 



A 



\ 



h) the in~stTiictof^s teaching 



2. What improvements would you sijp^st? 



o 
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E-1 Before 
E-2 After 
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FACULTY SELF-DESCRIPTION OF TEACHING 



Appendix E-1 



Department 
Instructor 



Course Number 



Quarter, 19 



The following Items reflect some of the ways teachers can be described, Please circle the 
number which Indicates the degree to which you feel each Item js descnptive^of^your teacn- 



number which ^ -- - ^ , 

ing in this course. In some cases, the statement may not apply 
Doesn't apply or don't know . 



Not at all 
Descriptive 



In these cases, ctieck 



2. 
3. 
4. 



6. Explain clearly 

7. Am well prepared 

8. Give. lectures that are easy to outline.. 

9. Summarize major points.^. 

10. State objectives for each class session. 

11. <j Identify what I consider important 

12. Encourage class, discussion. 



In teftchinq this course, I : 

1. Discuss points of view other than my own 1 

Contrast implications of various theories 1 

Discuss recent developments in the field. 1 

Give references for more interesting and involved 

points.... • ^ 

Emphasize conceptual understanding 1 

1 

1 

1 

1 

1 

1 

1 

13. Invite students to share their knowledge i experience 1 

14. Invite criticism of my own ideas 1 

15. .Know if the class is understanding me or not 1 

16. Have students apply concepts to demonstrate. 

understanding ••••• " "* 

17. Know when students are bored or confused 

18. Have genuine interest in students 

19. Give personal help to students having difficulties 

in course 

Relate to students as individuals... 

Am accessible to students cut of class 

Have an Interesting style of preselJtation 

Am enthusiastic abput my subject......'..., 

Vary the speed and tone of my voice 

25. Have interest 1n & concern for the quality of my 

teaching » 

:*ct1vate students to do their best ^^k, 

Give Interesting & stimulating assignments.. 

Give examinations requiring synthesis of parts o^ 
the course ? • • 

29. Give examinations permitting students to show. 

Ijndcrstanaing.. . 

30. Keep students. J nfomed of tneir progress 



Very 
Descrip- 
tive 



Doesn't 
apiply or 
don't know 



20. 

21. 
22. 
23. 
24. 



16. 
27. 
28. 



2 


, 3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


, 3 


4 


5 


2 


3 


. 4 


5 


2 


3 


4 


5 


2 


, 3 




5 


2 


. 3 


4 


5 


2- 


3 


4 


5 


2 . 


. 3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5' 


2 


3 


4 


5 


2 


3 


4 


5 


2 


. 3 


4 


5 


2 


3 


4. 


. 5 


2 


3 


4 


,5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


3 


4 


5 


2 


. 3 


4 




2 


3 


4 




.2 


3 


1 


5 



) (3^) 
) 



) 

) '(48^ 



( ) 



PLEASE TURN THE PAGE 
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Prior to this quarttr, how many times have you taught this course on the Berkeley campus2 

^tlmes 

When do you next expect to teach this course? 

Quarter, 19 



^ 6 



I, .How useful have*^ previous student evaluations' of this course been to you In improving: 

. Not at all Somewhat 
useful useful 

a) the course content or materials .1 2 3 4 

b) , the assignments or examination 1 ^ ^ ^ 

c) the course structure, format or organization 1 2 3 4 

d) the methods or approaches you use IjjXtachIng 1 2 3 4 

L To what extent do you feel this course-^ould be Improved, 1-e.. how satisfied are you with the course 
as you taught It this quarter? ? ' 

very Dissatisfied Somewhat Dissatisfied. Generally Satisfied. Very Satisfied. No need 

nSs Improvement could be Improved needs little Imprvement to Improve at this time 



Very 


.Does 


useful N' 


not api 


\ 


( ) 


5> 


, ( ) 


5 


( ) 


S 


( ) 



n) (2) (3) . 



S. How would you rate this c.Uss In tjrms of: • ^ . . \ 

very low very high 

a) your own personal enjoyment 1 2 3 4 5 

^ b) the level of -Interest shown by the students 1 2 3 4 5 

c) the level of performance evidenced by the 1 2 3.45 

students . 

Looking at the Items which yoi* rated as not especially -descriptive of your teaching In this class, which 
onets) would you most like to improve. If any? 



-3"^ Appendix E-2 

FACULTY SELF-DESCRIPTION OF TEACHING 

spartment^ , 

istructo r Course' Number Q uarter. 13 

. Tie following items reflect some of the wayi teachers can be described". .Please circle the 
number which indicates the'degree to which you^^eel each item is descriptive of your teacnr 
ing in this Course. In some cases, the statement may not apply. In these cases, check ( 
Doesn't apply or don't know . ^ 



/ „ Very Doesn't 

Not at all DescriD- aoply or 

I teaching this course, I : Descriptive ^ . tive ^ don't know 





z . 


3 


4 


, 5 


( ,) (-34; 




2 


3- 


4 


5 


( ) 


^ ^ ^ 11^^ WM^^* AM ^ ^ A ft J A 1 A a^MM^^ M ^ ^ « ^ ^ 1^ ^ * ^ 1 ^ m 1 


2 




4 


5 


( ). 


. Give references for more interesting and involved 


2 


3 


4 


s 


(' ) 




2 


3 


4 


5 


( )■ 




2 


3 


- 4 


5 


( ) 




2 


3 


4 


5 


( - ) 




2 


3 


4 


. 5 


( ) 




2 


3 


4 


5 


( ) 




2 


3 


'4 


5 


( ) ' 




2 


3 


■ 4 


.5 • 


•( ■) . 




2 


3 


• 4 


5 


( ) -. 


. Invitd students to share their knowledge & experience 1 


2 


3 


4 


5 


( ) 






3 


- 4 


5 


( ) 




2 


3 


4 


3 


{ ) 


. Have students apply conci^pts to demonstrate 


2 


3 


• 4 


5 


( ) 




2 


3 


4' 


, 5 


/ > 
\ i 




2<-. 


3 


4 


5 


( ) 


. Give personal help to students having difficulties 


2 , 


i 


4 


5 


i \ 




.2 


3 


4 


■ -5 


f \ 


Am accessible to students out of class 1 


2 


3 






{ ) 


. Have an interesting style of presentation 1 


2 


3 




5 


/ \ . 




2 


3 




5 




. Vary the speed and tone of. my voice 1 


2 


.3 


4 




\ f 


Have interest in J^oncern for the quality of my 


2 


3 


• 4 






. ^totivate students to do their- best work 1 


2 


■J ■ 




5 


• ; / 




2 


3 ■ 








. Give examinations requiring, synthesis of parts of 


2 / 


■J 








. Give examinations permitttpg students to show 


2 


• 








• Keep students informed of their progress.. .. 1 


2 " 


'3 
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*iovk useful were the suggestions or consultation in improving: , 

, Not at all Somewhat 
useful useful 

7 " 



r 



a. tne course content or materials 

D, tne assignments or examination « 

c; tne course structure* format or organization 

a) tne methods or approaches you use in your teaching 

e) ycur relations with students ' ' . 

f; the course overall 



. Very . jces 
jse^j' net acc' 



COi^r-IENTS: 



2. To what extent do you feel this course could be improved* i.e.* how satisfiied are you witn tne course 
as you taught it this quarter? 

Very Dissatisfied; Somewhat Dissatisfied, Generally Satisfied, Very Satisfies, no need 

needs improvement could be improved needs little improvement to improve at tnis time 

(1) (3) m ' 



3. How would you rate this class in comparison with the lastTtime you taught it in terms of: 

Much lower ■ Mucn nicner ^ 

a) your own personal enjoyment 1 2 3 4 5 

b) the level of interest shown, by the students 1 2 3 4 5 

c) the level of performance evidenced by the students 1 '2 3 4 . 5 

4. Looking at the items on the preceding page, are there any which you worked oh specially tnis quarter 
as a result of our consultation with you before the quarter be^an? 



Were there any other changes you made in the course? 




5. How do you think your students* ratings in this course this quarter will comoars w^tn you- -it'rds 
last time you taught it? 

Higher Lower The same 

C0W1ENTS: . * . ^ 
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Student Description of Teaching Computer Pri ntouts 
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MINTER 1982 



INOIVIOUM. TEACHER DESCRIPIIOli PROFILE 



QUESTIONS 



£t£«! ?2iri5.K JII^II.°"*« mii 

CMTRtSTS INPLICATIONS OF VM|OUS THEORIES 
lISniSSES RECENT AEVELOPNENTS IN THE FIELD 

K5s5gl5EJpS:L«S2SJ'* 

EIPIAINS aEMLf 
IS HELL FREPMEO 

EIVES LEaURES TV«T 4RE EAST TO OUTLINE 

SUNNMIIES NMOR POINTS 

STATES OBJECTIVES FOR EACH UASS SESSION 

"I"' *''*«^ CONSIDERS INPORTANT 
LNC0WA6ES CUSS OISCtSSTON 

2?5f!!IL'S.'"»*'"*" Rhohiedse ♦ experiences 

INVITES CRITtCISN OF HIS/HER. ONN IDEAS 

(ROMS IF THE a«SS IS UHDERCTAN0IN6 HIN/HER OR NOT 

S^y?I22f'l«JIcIi.'^53^SILP Pf'WS'Wtt UNDERSTANDING 
tNOHS HNEN STUDENTS ARE DOREO OR CONFUSED 

MS CENUINE INTEREST IN STIDENTS 

liffJcrSy^-SSb! »t HAVINC DIFFICULTIES 

lELATES TO STUDENTS AS INDIVIDUALS 

IS ACCESSIBLE IG STUDENTS OUT OF CUSS . 

IAS M INTERESTINB. STILE OF PRESENTATION 

IS ENTHUSIASTIC ABOUT HtS/HBt SUBJECT 

IA»IES THE SPEED AND TONE OP HIS/HER VOICE 

m.^^ffl.i^!?',^^?' Of TEACHIHC 

lOTIVATES STUDEKTS Tfl DO THEIR BEST WORK 

IVES INTERESTING AND STINULATINC ASSIGNMENTS 

IVES EXAMS REaUTRING SYNTHESIS OF PARTS OF THl COURSE 

IVES EJIANS PERHITTIMG STUDENTS TO SHON UNDERSrANOIW 

lEPS STUDENTS INFORMED OF THEIR PROGRESS 



ALL TEACHING EFFECTIVENESS OF INSTRUCTOR 
SE CONTENT I RATING ICGNPARB) TO OTHBtS AT UC) 



FREQUENCIES 



ENROLLNENTI 19D 
RESPONOENTSt IDS | 70.0 PERCENT) 



TOU TAKING THIS COURSE BECAUSE IT IS REQUIRED 



1 

m 


II 


III 

111 < 


If 


\ 
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99 
99 


It 
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17 
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90 

CT 




10 
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17 
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13 
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99 
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22 
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27 
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3 


cu 


9m 

cy 


9A ' 

20 


19 


6 


7 


9 


99 
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22 


24 
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23 


44 


*ll 


1 
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28 


25 


11 
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30 


22 
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20 
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48 
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43 


16 


10 
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10 
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12 
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44 


19 


JO 


27 
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16 


24 


28 


16 
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11 
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10 


14 


22 
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4 


12 


29 


3^ 


10 


18 


T 


16 


31 


28 


14 


.9 


10 


5 


19 


a 


4 
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1 II 111 l/ V VI Vll 



3,0 
2,7 
3,0 
•2.4 
2,T 
2.0 
2,3 
2,6 
2,9 
3,4 
2,9 
2.5 
2.0 
2,5 
2.4 
2.8 
. 2.6 
3.4 
3.6 
3.6 
3.9 
2.2 
2.9 
3.1 
3.2 

2.4 ^ 

2^5 

3.4 

3.3 

3.1 



9 33 22 11 11 
1 5 IT 



VI Vll ONIT 
4 0 5 
26 7 .5 



AV,tE9. 
3.0 
4.8 



- YES 
83 
I 79,0I 



NO 
20 
C 19.0J 



OMI 
2 

I 1.91 



ST.DCV. 

1.1 
1.0 

1.2 ' 

1*2 . 
Ul 
03 
1.0 
1.2 
1.0 
1«2 
1.0 
0,9 
Ul 
1.1 
1.2 
1.2 
1.2 
*1.2 
1.2 
1.2 
1.0 
1.0 
1.2 
1.2 
1.3 
1.1 

0,9 J 
1.0 

Ul 
Ul 



ST.OCV. 
1.3 
1«3 
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milTfl 1913 
tUH% 



IMOIVIOUAL fl 
I I 



1 DISCUSSES POINTS OF VIEM OTMER THAN HIS/NiR OMN 0 

t COMTKASTS ItlPLICUIDNS OF VARIOUS THEORIES 0 

I DISCUSSES RECENT tiEVELOFNENTS IN TNE FIELD 0 

r.PRESENTS ORIGINS OF IDEAS ANO COlittFTS i 
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Appendix G 

Cover Letter Accompanying Returned Materials 




Berkeley: TEACHING INNOVATION & EVALUATION SERVICES 
TIES 



TO: 

FROM: . . X 

■■ ■ \ 

RE: TEACHING EVALUATION CONSULTATION SERVICE 

. ' ■ \ \ .> - ■ / ■ 

Enclosed are the computer summarized results of the student evaluation forms 
'collected in your class. last term. The original questionnaires, on. which the 
summary is based, are also enclosed. - ^ 

-In the next week or two, I will call to schedule an appointment. to discuss the 
findings from the evaluation and to make suggestions that migjbt be useful in 
improving the next presentation of the course. If you have any questions, please 
can me at the TIES office (2-6392). 



In interpreting the results from ypur class, we suggest that you: 

1. Note those items which h«ve a ^arge "omit" rate. Students marked these items 
"Doesn't apply or don't know", or lef^^L^hr^em blank. These items may well 
be inappropriate for describing yXPSfr^urse. If so[l ignore them. 

• . .. - ^ ■ ■ ■' • ' . ■ ■ • 

2. .Note th? 4 to 5 .items which have the highest average responses , and. the 4 to 5 

' items which have the lowest average responses^ and Consider each of tfiese items 
in light Qf your course objectives, philosophy of teacliing, etc. 

It is important to remember that even though these items and scales were ' , 

developed out of research on effective university teaching, at, "low" or "high"- 
score on any given item cannot be. interpreted as indicative of ^good" or "bad" 
teaching per se; the meaning of any item or scale score can-^n4i(^b« interpreted 
in lig^t bTsuch factors as your own objectives for the coursie, the, level of • 
the course, the nature, of the content, etc. . * 

3. Mote the response frequencies for each item' (number of studentsr-who said 

item was "not at all descriptive" or "very descriptive" of you in this course.* • 
By noting the range of student respCm&esHo an Vtem, you will be able. to identify 
those items on which there is the greatest -and the least consensus among studen-s. 
Your conclusions regarding the meaaing of an item rating may differ depending ' 
on the degree of student consensus. , ; . 

4. Read the open-ended responses made by. your students on the back page of> the 
questionnaires themselves to see to what exter^t these cornnents corroborate, 
contradict, or elaUOrate the conclusions yjou have drawn from analyzing the 
summarized data. These open-ended items are also an important source of inforaation 
not covered by the ^ructured questions and can be very useful in making chances 

in the, course in the future. 
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Tc\s COM 



iPARISON DATA Nome 



Teaching Innovations and Ocpartincnt: 

Evcluatio.1 Services (TIES) ^ ^^^^ / Enroll-nent / % Response 

262 Stephens' ' 

542-6392 ' T* — " ■ " 

. „ Time 2 Date / Errronment / Response 



* -Sui!ir.!sry: ^/ 30 items went up 0.5 or more items at 4.5 or above. Time 1 

• /30 items went ^own 0.5 or litems at 4.5 or above, Time 2 



more 



^items at 3.5 or below. Time 1 

/30 items v/ere tied or 

varied + 0.2 or less . items at 3.5 or below. Time " 



Item Time 1 . Time 2 Change jtem Time 1 T ime 2 Changf 

1 . • . - 17. ' 

2. _ " - 18^^ . ■ '. . 

'3. 19! ■ - 

\ r 

-4. 20. ^ 



5. .21. 



6. • 22. 



7. 23. 



8. ■ V • 24. 



9. ^ . 25. 



10. • ; 26. 



"T" 



11. ^ 27, 



12. 28. 



13. 29. 



14. 30. 



1 . . ' O verall Ins^t^. 



16. ■ Overall Course 



I tei 'is v/hicii you in dicated y ou_wpxkgj_Q!l' 



* To date dp not have, enough e;:poriencG with this project to determine v.t.at 
constitutes a significant- difference for these data. There arc a number of 
factors involved, e.g., class size, the amount -f student consensus on each 
iten.^ how high the initial ratings for each item wore, and the rclativo 
difficulty of increasing one's ratings on Qach of the 30 items. Wc fed 
rc.isonabiy certain, however, that diffcrehcec'-of 0.2- or less should be con- 
iiderpd "no change"; and that d'ifferences of' 0.5 are probably significant. 
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TEACHING INNOVATION AND EV.ALUATION SERVICES 
^262 Stephens Hall 



COMPARISON OF STUOE^'* RATTNGS. OVER TIME 

Hu m ' • Ccrst 

Tine 1 Tine Z Time 3 



Oate: 

Enrol laent: 
Percent Resporvse: 



Mean Statlngs on a 5-po1nt scale 
(Where 1» Not at all Descriptive and 5f Very Oescrlptive 
Time 1 Time 2 Tine 3 



* 1. Discusses points of view other than his/her ONn....... ^ 

2. Contrasts, iinjlicationj oip various theories...-. 

3. Discusses ^recent developments in the f 1^1 d . 

4. Gives references for aore Interesting « Involved 
polats . 

5. &nphas1zes conceptual understanding % . — : 

6. Explains clearly — — — . — 

7. |s well prepared — — L — 

8. Gives lectures that are easy to outline ^ . 

' 9- SwMrizes major points j 

10. States objectives for each class session J. . \ 

11. Identifies whar he/she considers Important... « , ^ :^ 

12. Encourages class discission ^ 

13: Invites students tc share their knowledge and 

ex;(er 1 ences . • '. . « 

14. Invites criticism of his/her own l^eas ^ 

15. Knows if the class 1$ understanding him/her or not... 

16. Has students appiy concepts to demonstrate 
understanding 

17. Knows when stud^ts are bored or confused " 

13. Has genuine Interest In students..,: — ^ ■ 

19. Gives personal help to students n)iv1ng difficulties 
in course ^ 

20. R^laus to students as individuals...*. . 

21. Is accessijle to students out of class . , 

22. Has an Interesting style of presanUtion , 

23. Is enth^slascic about his/her subject!.,. ~ 

24. Varies the speed and tone of his/her voice. ^ 

25. Has Interest In and ccncem fqr the quality of \- 
I his/her teaching... . . > 

26. Motivates students to do their best work — ' • 

27. Gives inter$jfi1ng and stimulating assignments 

23. Gives examinations requiring synthesis of parts 

of the course ^ - ^ — ^ 

29. Gives examinations permitting students to show 

understanding 

30. Keeps students informed cf their progress... . — ' 

Mean Ratings on a 7»ooint Scale 

Time 1 Time 2 Time 3 

1. Considering both the limitations and possibilities of thesubject 
matter & course,how would you rate the overall teaching effectiveness 
of this instructor? . 
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Appendix I: . Sample Ideas 



This appendix Includes a. sample of 
26 ideas 'for item 15: Knows if the 
" "fclass is understanding him/her or 
not. The purpose of this appendix 
T?"to give 'the reader a sense Qf 
the type and range of ideas used in 
our consultations. > 
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Know if the Class is Understanding^ You Or Not 



Getting and Using Feedback . , " ' 

Number 84: Increase ydiir eye contact with students. 

Number 86: Ask .students if they .understand what you are saying. 

Number 86: . Call on students to paraphrase what you have said or 
to summarize major points. 

Number 87: Begin your lecture with a series of questions. 

Numbie ^86:' Ask questions of the class during lecture. ^ 

Number 89: Give students problems to solve during class time. 

Number 90: Reserve the last 10 minutes of class for questions,. 

Number. -91: Give frequent ansignments. 

Number 92: Give frequent quizzes. . ' - 

Number 93: Schedule an oral quiz with each student. 

•Number 94: Schedule individual appointments, with students. 

Number 95: Assign minute j>a per s at the end of a crlass session; 

; Number 96: Use index cards to get feedback. 

% # • . 

Number 97: Ask students to ^ive definitions, associations. or 
applications^ of concepts or ideas. * ^ 

Number 98: Use a questi^bn box to solicit students' questions, 
comments' or problems^ ' * * 

!4umber 9^:^ Periodica.lly^ borrow students' lecture nates. - 

Somber 100: Encourage students to form study groups and send 
representatives to' see you about difficulties the groups^ 
■ might be ^having.' , ' ^ \ 

. Number 101: Establish a Liaison Committee.* . , . 

14umber 102: Install a telephone "hotline". . 

Number 103: Attend or lead lab -or discussion sections yourself.- 



Number 104: Have students turo in their iecture notes as a course 
*assignment • 



Evaluating Instruction 

Number 105: Hand out short questionnaires to get feedback. 

' ' ' ■ • 4 

Number 106: Have studejits send you a telegram evaluation. 

Number 107: Invite a member of TIES to conduct an oral evaluation 

with your students.. i . ^ ^ 

* \ 

Number 108: Videotape your class. ' < 

Number 109: Respond to student suggestions and critjicisms with' a. 
- visible sign* ' 
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File name: 84 



IF YOU WANT TO: - * ' 

o ^^ Know if the class is understanding you or not 



o Kn 



ow if the students are bored or conf^^ge^^^^^^ 

'6 Have a more interesting style of presentation 

YOU MAY WISH to" CONSIDER: 

Increasing the amount of eye-contact you have with the stu- 
* dents during your lectures. ^ 

"I look carefully at students' faciesr" says one history pro- 
fessor. "You can't teach a^bored or confused class- so if I 
see a glazed loolc which suggests that students are not fol- 
lowing me^ I interrupt my lecture and say^ 'We may be going 
too fast... /•or 'This point doesn't seem to be clear to 
some of you, ~ 

Some faculty members prefer to direct their questions to the 
entire class; * others find it effective to call on students 
by name r interrupting their lectures to say/ "Jerry, y^om 
look like you had a question," or "Several of you looked 
puzzled. Sally, can you tell me what doesn't seem to be 
clear?" 

One psychology professor says that he was once assigned a 
room so poorly lit that' he coi:ld*not see the' students from 
.the platform until he moved down to the floor level. * In 
teaching in a new room, note any physical obstacles that may 
ix\tet±%xe with your eye-contact with students and make what- 
ever changes are possible. / 

A professor of English sbys that because h^i is very near- 
sighted,, he has learned to listen carefully and pick up cn 
auditory cues which may indicate that th6 students are bored 
or confused. ^I find that the. rustling of papers or th% 
scraping and squeaking, o£ chairs are excellent indicators 
that students are having difficulty," he' s^^ys. 

- ■ ■ . ^ 



Limitations on Use of Sugge^iun 

Discipl ine: None 
Course Level: None 
Course'Size: None 
Node: Primarily lecture 
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File name: 85 




IF YOU WANT TO: 

o Know if >the class is understanding you or not 

o Know if the students are bored or confused 

o Clear up any confusion students may be having 

o Identify what is most important or most difficult for 
students 

YOU MAY WISH TO CONSIDER: 

Asking students directly whether they understand what you 
are saying. 

Many excellent teachers punctuate their lectures with? such 
questions^ as r "Is this explanation sufficient?" or "Do you 
agrer?" dx 9 "Was that rlear?** 

-Ho* ever r as one art history teacher reports, "Sometimes the 
s adents look confused^ but won't ask questipns. This tends 
.0 happen especi^illy toward the beginning pf 'the course. 
When it do^s happen, I say something like, 'Perhaps you 
don't have any questions just yet, but I have a feeling i 
passed over X-topic very quickly. Let me say a few mor^i.' 
words about that, because students often find it difficult 
to understand the, first time around. In this way I let the 
students know that it's OK to be confused* It'^ OK to ask 
questions in my class* By the second or third week, they 
usually feel comfortable enough to 'say that something is 
still not clear to them." • 



Limitations on Use of Suggestion 

Discipline : None 
Course Level : None 
Course^Size: None 
Mode: Primarily lecture 
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Fil6 name: 86 

IF YOU WANT. TO: . ^ 

o Know if the class is understanding you or not 

o Krtow if students are bored or confused 

o Summarize major points before moving on to . another 
topic ' , ■ / 

o S'mphasize Conceptual understanding 

o Teach students to be active listeners 

YOU MAY WISH TO CONSIDER: 

Calling on students to paraphrase or summarize what you have 
just said. 

"Asking students if they understand gets you only so far," 
one history teacher ekplains. "Asking Ms. Jones to sfummar- 
ize tb'e main things to remember^ about X^ and^ then asking 
other- students to help out if she is having difficulty is a 
far better check on students' understanding." 

Asking questions of specific ^students has other benefits 
too. For example, because students know that they may be 
calli6d upon^ they 1, oten more attentively for the main ideas 
and that in turn helps them to organize their notes better. 
\ Qetting students to summarize periodically also breaks the 
monotony of a 50-minute lecture. 



Limitations on Use of Suggestion 



Discipline: None 
Courae Level: None 
Colirse Size: None 
Mode: None 
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File name: 87 . ■* . 

IF YOU WANT TO: _^ 

o Know if the class is understanding you or not 
o Give students the opportunity to ask questions 

AY WISH ^0 CONSIDER: ' . 

« 

Beginning your lecture with a series of questions. 

A* zoology- professor does this at the beginning of the week. 
He opens class with a question like, "What is bothering you 
about the material we have discussed so far?" or "Is there 
anything from last week that you would like to go over 
again?" 

He th^n takes a series of questions, making notes on the 
board/ without responding. Sometimes he .pulls the questions 
together and gives a mini lecture or review ,(like a composer 
takirtg a few notes from the audience and then composing a 
concerto) . Other times he addresses each question sequen-' 
tiZly. 

f 

■ ■ / . ■ ■ , — . 

Liinitfitions on Use of Suggestion 

Discipline: None 
Course Level; None 
^ Course Si ze ; None 
Mod«; None 
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File name: 88 



IF YOU WANT TO: 

Know if the class is understanding you o^ not 

Have students apply concepts to demonstrate understand- 
ing 

o Introducing variety into your lecture 

YOU MAY^ WISH fo CONSIDER: . 

Asking questions of the class during lecture. - 

Several professors routinely . intersperse questions into 
their lectures. As he prepares his 'lecture notes, .for exam- 
ple, an engineering professor identifies key places where he 
can stop and ask the class a leading question. In describ- 
ing a particular process, he might pause to ask, "Now who 
can tell me what happens next?" and then call on a specific 
student or wait until someone responds. 
") « 

"It's important to ask questions of students as you are lec- 
turing, ~ 'he .explains. •'Fi.rst, It makes students active 
learners so that they must think .about the mater iaT, rather 
than just passively absorb it. Second, it helps me to know 
if they are understanding what I am saying." ^ ' . , • 

As Ti variation oh ' this *^technique, he poses a problem and has 
student^ try to answer it in writing. He circulates while 
they are working, observing their problem-solving approaches 
and identifying their difficulties. After two or three 
minutes, he calls -for solutions an*- leads a discussion on 
how students approached the problem. 



o 
o 



Limitations on Use of Suggestion 
Discipline: None 

Cdurse Level: None ^ . / 

Course Siz(B:/None " ^ 

Mode: None / ' 



File name: 89 i " ^ 

IF YOU WANT TO: 

o Know if the class is understanding you or not 
t> . I^ow if the students are bored or confused 

♦ • • 

o Have student!^ apply concepts to- demorvstriite understand- 
ing 

o help to students who are having difficulty 

YOU MAY WISH TO CONSIDERi ^ 

Giving students problems to solve during class time so that 
you' can observe any difficulties they are having. 

One physical science teacher who uses this technique begins 
by outlining and' discussing a major concept. He then g Wes 
students a specific short problem and asks them to' take 10 
minutes to try to apply the new concept. 

* 

"While the students ^re working, X walk up and down the 
aisles * observing. At the end of 10 minutes or so I summar- 
ize some of the common errors they^jnade, why I think they 
made them> and then .give thetn tips on some' of the most 
fruitful strategies for solvijig that kind of problem." 

Having the students try an immediate application *of a new 
concept greatly\,reinforces their learning, he believes. "By 
observing how they tackle a problem, I become much more 
aware of any difficulties they have understanding the con- 
cept and can correct those misunderstandings^ on . the spotl". 

- - • ■ . . ' . ■ / 

A variation on this technique is used by a drsiaatis^art- 
teagher in studio courses. "Whenever I notice sb<nething 
especially good or bfad in a student's work," he says, "I 
call the other students over and use thct as an opportunity 
to share the^ information with the group ' 



Limitations, on Use of Suggestion 

Discipline: None 
Course Level : None 
^Course Size: None ( 
Mode: None 



File naine:^90 

IF YOU WANT TO: ' " * . . 

o Kno^ if the class is understanding you or not 

o Gi,Afe students an opportunity to ask questions ^ make 
comnvents ^ 

\- % • ' ' ■ 

yOU>IAY WISH TO CONSIDER: / ^ 

Res^ervi,ng the last 10 minutes o£ class for questions. 

A' faculty member in the humanities wanted to provide oppor- 
tunity for student questions during his lectures, but he. was 
concerned that the questions might monopolize class time and 
take them aff the topic, "I .decided to reserve the last ten 
minutes of class for student questions," he says. "I feel 
better-'knowing I will have the time to present . the material , 
and students feel better knowing they have *an opportunity to 
clarify^ points they may not have understood." 



Limitations on Use of Suggestion 
Discipline: None > 

Course Level: None ^ ^ 
Course Size: None 
Mode: Lecture 
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File name: 91 
IF YOU WANT TO: 

o Know if the class is understanding you or not 

o Know if students are box^d— or^^onf used 

• *•'*■• '• 

o Have students apply concepts to demonstrate understand.- 

ing ' 

-'O identify problems individual students may be having 

• YOU MAY WISH TO CONSIDER: 

Giving ' frequent (weekly or biweekly) assignments. 

Most excellent teachers give students frequent assignment^ 
which allow them to apply course concepts\and improve com- 
munication and problem-solving skills. Even in very large 
classes^ these" instructors make a point of reading and com- 
menting on at least a sample of the papets or problem sets. 

"If you assign papers," one humanit^ies teacher says, "it's 
critical that you as well as the.TAs or Readers read them. 
Otherwise r you* don't get the feedback." A faculty member in 
a professional school says that he always asf^igns three 
papers in undl&rgraduate courses and four in graduate 
oourses. "I want them to learn to write," he says, "and 
because the papers are always tied to the r(eading assign- 
ments, --they allow me to see how well students re-ally under- 
stand the material." 

One faculty member requires students to write very short 
(one' or two paragraph) abstracts or summaries of each read- 
ing assignment and to turn them in each week. "Although 
some students consider this very 'high school *, most find it 
useful for keeping up with the reading. The students also 
find these summaries useful for review and they help me know 
how well the stoxdents understand the material." 



Limitations on Use of Suggestion 

icipline: None 
Course Leval : None 
Course Sizs: ^'one 
Mode: None / 
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Suggestion Number: 92 

IF YOU WANT TO: 

o Know if the class is understanding you or not 

o Know if the students are bored or confused. 

o Identify and help students who are having difficulty 

4 o Know the kinds of difficulties students are h.^ving 

* ■ - 

YOU MAY WISH TO CONSIDER^. 

Giving frequent quizzes. ^ 

One excellent science' teacher g^ves. students pi;.actice 
quizzes (of 10 to 15 minutes duration) throughout the quar- 
. ter. "I don't grade the quizzes," he explains, "but I do 
read them and review any material with which ^a large num|?ejr 
of students seemed to have difficulty. 1 also seek oqt any 
students who see4n to be having real problems understanding 
the material and spend more time with them in my office or 
in the departmental course center." 



Limitations on Use ofSur estion t 

Discipline^ None 

Course Level: Under^graduate 

Coursje §ize: None 

Mode: None ' v 
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File name: 93 



If YOU WANT TO: 



o 



Know if the class is understanding you or not 




o 




o 



Kjet to know your students better 



YOU N'AY WISH TO CONSIDER: 



Scheduling an oral quiz with each student in your office,. 



One .teacher of engineering reports giving oral quizzes in 
vhich ^ a student is given a series of problems to solve on 
the blackboard in his office. He has found this technique 
invaluable in understanding* hoW students tackle probl^^ms. 

"If you look only at students' homework," l)e says, "you'll 
know whether they got a problem rights or wrong/ but it won' t 
tell you why. Observing students as they apply concepts and 
solve problems gives you much more useful anformatLon about' 
where your explanations or those of the textbook skip a step 
or are unclear . " \ 




^Limitations on \Use of Suggestion 




Discipline: Sciences and professional 
Course Level: Nope 
Course Size: Probably not above 30 
Mode: None 



/ 
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File name: 94 




Knbvw if the. class is understanding you or riot 



o 



rnow if students are bored or confused 




Get to know your students 



o 



"^ive help tdents who are having difficulty- 

Encwurage students to come see you during office hours 



YOU MAY WISH TO CONSIDER: 

. Scheduling an individual appointment with e^ch student. 

A statistics professor felt that he was not being successful 
- - in generating class discussion. At the end of the third 
weeky still unable to encourage class participation^ he 
d^ecided to pass around a sheet of paper with a list of 10-;^ 
minute blocks of time when he would beavailable for indivi- 
d ua 1 appo intments • 

Each^ student* wa5 required to sign up for one of the 10 
minute appointments,/ They were told that the chief purpose 
was for him to get to know the students better and to listen 
to any compxairits or suggestions they might have, 

"I found that this was a real ice-breaker^" he explains, 
"Even though most of our discussions were mainly chit-chat^ 
some students used the opportunity to indicate prob^lems they 
were having in the course or to make suggestions about 
course improvements. Perhaps the chief benefit was that it 
gave me an/ opportunity to get to know the ,rtudents. As a 
result,, they seemed to feel more comfortable asking and 
answering quest i oris in class , 

• " c > 

" "In addition^ several students who were having problems 
understanding the mat:erial began to seek me out after class, 
I'm not certain they would have done so if I hadn't made 
this effort to get to know them individually," 



Limitations on Use of Suggestion 

Discipline: None 
Course Level: None 
Course Size: Up to 50-70 
Mode:^ Lecture/discussioij:. 



Pile name: 95 

IF YOU WANT TO: , . • 

o Know if the class is, understand ing you or not 

o Know if students are bored or confused 

o Encourage students to listen actively during lectures 

o Givc> students experience writing short essay answers - 

YOU may' WISH TO CONSIDER: 

Assigning "minute papers" at the end of some l^i^ctures. 

, ■ ■ * 

"Minute papers^" as used by a professor of physics/ consist 
of two questions to which' studen'ts give written re^ofises at 
the end of each weekly lecture. "I call them "minute 
papers^'" he says, "because I preface them with the request 
that they take a, minute or two to write on these: two ques- 
tions: 

(1) What is the most significant thing' you learned 
today? and 

(2) What question is uppermost in ypur mind at the end 
of today's session? 

"The minute papers started out purely as an attendance dev- 
ice," he. explains. "As I began to read their responses, 
however, I f ojjjid^- therru very useful in evaluating how success- 
ful I had been in conveying the material th$t day. In fact, 
nojw X often quote one. or two of their essay responses at the- 
beginning of the next discussion period to get the discus- 
sion started." 

As is the case with many educational experiments, this one 
had an additional, unintended benefit. "Because these are 
mainly science stt Jents who are seldom asked write, I 
pointed out that ^riese minute papers were good practice for 
the e*ssay question* which would constitute' my final. As the 
tetm progressed, i noticed an: improvement in the papers: 
^.hey became longer, better developed, and .more carefully 
phrased . " 



Limitations on Use of Suggestion 

Discipline: None 
Course Level: None 
Course Size: None 
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File name: 96 

IF YOU WANT TO:. * p-. 

- . , • < • * . . X* 

o Know if the class is understanding you or not 

'* ' ' ' 

o Know if students* are bored or confused ^ . ' 

o Give students opportunities to suggest improvements in 
^the course 

YOU MAY WISH TO CONSIDER: 

Distributing index cards several times during the semester 
and asking students to give you feedback^ on th^ course. 

A professor of education asks students to respond^ to two 
, questions/ one on the front 'and one on the back of the ind^^x 
cards. The two questions he uses are^ "How's it going?" 
and, "Any suggestions?" 

• .^Qf coi^rsle, if you have reason , to think that there is a prob- 
lem ; with a 'specific- aspect' of - the course , yb,a will get 
better information it you target your questions accordingly. 
For example > "Any jSriablems with the text?*! ..or "Students' 
have complained in the' past that I lecture too fast. .- I've 
been trying to improve, is my lecture pace a pioble:,) for 
you?" . ' .' . » 



Limitations ori US,e 6f Suggestion 

Discipline: None ^ ' v 

Course Level:' None • 
Course Sizes NoRe 
Mode: None 



Filp name: 97 • ' 

IF YOU WANT TO: ' ^ 

o Know if the class is uriderstand,ing you or not 
o Know if the students are bored or confused 

YOU MAY WISH TO CONSIDER: Ik 

• Asking students ' tq give defini^tions ^ .associations ^ ^rid 
applications for difficult concepts or ideas. 

Instead of waiting until the midterm or final to find ^out 
how many students understand the mater ial ^ . try handing , out a 
^ short questionnaire or quiz on the basic concepts covered 
that day. and/give the students time (10 to 20 minutes) to 
complete them at the end ,of the hour. 

An example of a questionnaire or quiz cover ing Concepts for 
the week might regcj; , * y 

-4^Goncept Definition. As I understand it^ the ra^in 
j idea (concept, point, etc.) of .today's lecture (or dis- 
I puss ion) was: ^ ^ . 



_. Concept Applications. A good example of an applica- 
tion of this idea (concept, point, etc.) is: 

C. Concept Associations*. In my mind the .m^ain point of 
today's lecture is most .closely related to ♦'.h^ follow- 
ing concepts^ ideas, pebple, placef, proce .-.^ .?s; events , 
or things. (Have students list several i :^^n\s) . 

This suggestion was taken and adopted from Otirp Ewing Lan- 
caster, Effective Teaching and Learning , N.Y. : Gordon and 
Breach, 1974 pp. 70-71. One variation on this is to give 
the questions as take-home quizzes in which case you may 
want to insist that the students choose different words (in 
giving definitions) and examples from those presented* in 
lectures' or assigned readings. Another variation is to call 
on particular students to answer each question orally at the 
end of the hour. # . ' 



Limitations on Use of Suggestion 

* * «k 

Discipline: N6ne 

Course Level: None 
Course Size: None 
Mode: None' 



F.ile name.: 98 

IF YOU WANT TO: " 

o Know if the class is understanding you or not 

. o Know if students are bored or confused 

YOU MAY WISH TO CONSIDER: . 

Using a question box to solicit students' questions^ com- 
i^ents or problems.. . ' 

M psychology teacher places a box in the back of the room 
irci student questions, comments or^ problems. Students can 
drop questions anonymously into the box at the beginning of 
the class or during the break. After %he end of the period, 
tne teacher collects tha box and' reviews the questions. 

This technique gives f?,tudents an anoriymous means for making 
> their troublesome areas or questions known to the instruc- 
tor. Tt can also help a faculty member identify major areas 
of difficulty wherever the same problems are raised by 
several students. , 



Limitations on Uf^e.of Suggestion 

Discipline: N'^ ne 
Course Level;. None 
Course Size: N:>ne 
Mode: None 



File name: 99 . • 

IF YOU WANT TO: ' ' . 

o Know if the class is understanding you or not 

o Know if the students are bored or ponfused 

- • • • ' ' - \, 

YOU MAY WISH TO CONSIDER: ^ 

Periodically borrowing lecture notes from . several students 
in your class/ . 

The best way to sel^^ct ^^tudehts* notes is at random • - 
Faculty members who have! used \this technique warn that it 
can be a very chastening as , weri^-^as useful experiencef, 
"There was an incredible difference between what I thought I 
had said and the' points I thought I l^dd* stressed, and what 
the students heard or felt was important to write down," one 
faculty member reported^ 

,This axercii^e can be especially useful if previous student 
evaluations have indicated: (1) your lectures are not as 
well organised as they might be; (2) students find it diffi- 
cult: to identify wfiat is most important; or (3) your lec- 
tures are so tightly packed and delivered so rapidly that it 
is difficult for students to take good notes. 

A variation on Lhis suggestion is to audiotape the lecture 
3S well. Thjs allows you ^to ' do a three-way comparison 
between what you thought you said (or intendecj to say), what 
you can hear yourself actually saying (including the way in 
which you said it), and what a^ random sample of- students, 
thought you said (or thought was important enough to write 
^ down) . % ^ 



Lini atic.is on Use of Suggestion 

DiscipJitie: None 
Course L6vel: None 
Course Size: None 
Mode: None 
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Suggestion Number: 100 

. IF YOU WANT TO: ^ • 

' o Know if the class is understanding you or not 
o Know if the students are bored, or ced 
o Help students get to "know one another 

0 

YOU MAY WISH TO CONSIDER: 

Encouraging students to form small study groups and t;o send- 
representatives to see you ^bout any difficulties their 
groups are having. 

One humanities teacher who does this says, "Although I 
encourage tn.e students to come see me about any problems 
they are having, with the course, freshmen are often loathe 
to do that. By encouraging them to form study groups, I am 
trying to help them get to know at least some of their fel- 
low students and to take advantage of what they can learn . 
from one another. . 

*iM "Also , il; seems to be easier for some students to come to me 

for assistance if they 'represent' a group, because the 
problepts are then seen as cc mon to many students not just 
- the group's representative. Faculty members can be very 
intimidating for some freshmen , even those of us who try 
very hard not to be. Also, many of these students were at 
the top of their hign school classes and it is difficult for 
them to adjust to the competition at Berkeley. While it is 
difficult for them to admit that they don't understand some- 
thing ,v"there is a certain comfort in knowing that some of 
thpir fellow students are in the same boat and that, by join- 
ing forces they can help one another.* 



Limitations on Mse of Suggestion 

Discipline: None 
Course^Lavel : None* 
Course Size: Over 15 to 20* 
Mode: Lecture 
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File name: 101 

IF YOU WANT TO: , 

o Know if the class is understanding you or not 

o Know if the students are bored or confused 

o Get to know at least some of your studeifts 

o Identify any problems students may be having in the 
course * ^ 

YOU MAY WISH TO CONSIDER: 

^ . • - 

Estal)lishing ^ Liaison Committee of three to five students 
to meet with you once a week to discuss student difficulties 
^ or dissatisfactions. 

In a very large class^ the students should be selected on a 
"district" basis -so that all students have relatively e^sy 
physical access to one of the members of the Liaison Commit- 
tee, You can rotate fiembership on the committee from a list, 
of volunteers^ but be sure the entire class knows- who the 
Liaison students are at any given time and how and why they 
s'hould use them. Be sure^. too^ that the Liaison students 
, understand their function and encourage them to. circulate 
and seek out information frojn the tfther students, • 

This technique w^s initiated as a research project at the 
University of Minnesota arra has been used successfully by 50 
teachers at the University of Texas, Evaluations of its 
usefulness for both students and instructors indicate that 
most students felt that actual improvements had been made' in 
the course as & result ofithe committee's interaction with 
'the instructor^ and studehts especially ap'preciated the 
opportunity to get to know one of their instructors better. 

Benefits, c'i ted by faculty included increased faculty aware- 
ness of student learning needs and increased student aware- 
ness of the. instructor ■ s teaching problems and educational 
philosophy. 



ERLC 



Limitations on Use of Suggestion 

Discipline: None 
Course Level: None 
Course Size: None 
Mode : None 
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File name: 102 



IF YOU-.WANT TO: 




o 



o 



6 



Receive on-going feedback from students 



YOU MAY WISH TO CONSIDER: / 

^Installing a telephone, "hotline". 

A telephone "hotline" allows students to report course- 
related difficulties at the time they are having them, e.g., 
at 10:00 PM whfen trying to solve a problem or understand a 
difficult section in the text. One economics professor' 
received a mini-grant from the Academic Senate Committee on 
Teaching to install a' teleph^one Answering service in the 
TA*s room and has used it for several years in * a large 
introductory course. 

^ "Students are reminded of the availability of the 'hotline' 
throughout the course," he explains. "Although they can 
call me or the TAs directly during' regular hoursr this 
allows them to report difficulties at odd houVs or to regis- 
ter anonymous- gripes on the tape. Each morning one of the 
TAs listens to the tape and refers the problems that should 
be taken up in lecture to me and those which should .be taken 
up in the discussion sections to the other TAs,." 

-"Perhaps the most useful aspect of the telephone hotline is 
as a safety valve," the instructor explain^. "There is no 
way a course of 800 is going to be anything but impersonal. 
I try to acknowledge that and giye students as many chances 
as possible to be heard." 



Limitations on Use of Suggestion 




Discipl ine : None 
Course Level : None* 
Course Size: Above 150 
Mode: Lecture 



Pile name: 103 



IF YOU WANT TO: 

o Know if ,the class is understanding you or .not 
o Know if the students are bored or -confused 
o Give help to students who are haying problems 
o Get to know at least some of your students 

YOU MAY WISH TO CONSIDER,: ^ * 

Attending or leading lab or discussion sections yourself. 

Several faculty report that they always lead one lab or dis- 
cussion group themselves so that they have firsthand 
knowledge of how the course is going. 

"Students vary considerably in their command of prerequisite 
subject matter in this course," one. faculty member explains. 
"It's a .tough course and the chief task is to find out .^as 
soon as possible who is going to have trouble and to give 
' them help early on. I can't find that out sitting in my 
office; I can't always depend on the TAs to let me know; 
Also 4:he atmosphere in the biological sciences is so 
fiercely competitive, many of the students try to hide their 
weaknesses until it is too late for me ,to help them." 

"Another faculty- member i'r^N the sciences agrees. "I find 
thete is no substitute for knowing firsthand how students 
are doing, 'what parts of the course they are grasping well, 
what parts^ need more explanation or morg opportunities for 
practice. " * 

Many excellent teachers also attend the* lab or discussion 
groups led by their TAs jrto observe or to participate. In 
labs, they circulate through the .lab,' observing, asking 
questions, or lending a hand to students who may be having 
special difficulties. In this way, th^y also hope to pro- 
vide the TAs with go#d role models. 



Limitations on Use of Suggestion 

■ . ^ * 

Discipline : None 

Course Level,: None / 
Course Size: None 

Mode: Laboratory or discussion sections 
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File name: 104 . . 

IF YOU WANT TO: ; . 

o Know if the class is understanding you or not 
o Give help to students who are having difficulty 
o Motivate students to do their best work 

YOU MAY WISH TO CONSIDER: 

Having students turn in their lecture notes as a course 
assignment. 

/ 

One faculty member in engineering requires that students 
hand in their lecture notes, course assignments, homework, 
quizzes, etc., two or three times a term, , typfcally before 
the midterms pt .final exam. Students must prepare a 
detailed tablfe of contents to accompany their notes. 

"I find this is a good .way to get a sense of how well stu- 
dents are understanding the mater ial explains the profes- 
sor. "If someone is having difficulties I can spot them and 
^give them some help." 

"As ah added bonus, students are able to leave this intro- 
ductory course with a good set of. detailed notes, and a use- 
ful table of contents, which will make it easier for them to 
locate this material when they ne6d it .in their later course 
work." > 

. 4- • -■ ■ 



Limitations on Use of Suggestion 

Discipline: None 
Course; Level: Uone 
{ Course Size: None 

Mode: None 
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File name: 105 

IF YOU WANT TO: 

o' Know if the class is understanding you or not 
o Know if students are bored or confused 
o Clarify reasons for students' confusion or boredom 
o Get specific feedback and suggestions during the term 

you MAY WISH TO CONSIDER: 

Periodically handing out short *^ q^ oh spec^ific 

aspects of the course. 

This is a form of what professional evaluators call "forma- 
tive evaluation" (as differentiated from a "sumifnative". or 
end-of-course evaluation) . ^It is designed solely to give 
you very specif ic^ concrete information on^where you can 
make improvements in course content or organization, assign- 
ments, or aspiectis of your own teaching effectiveness during 
the same term rather than next time you teach the course. 

Formative evaluation can be especially helpful^ i^ you are 
-^teaching a new or substantially revised course, adopting a 
new text or lab-manual , or experimenting with .a new mode of 
instruction. Many faculty members routinely administer spe- 
•cially tailored mid-quarter • evaluations. Generally, they 
report that these evaluations dramatically improve ,thefr 
communication and rapport with students, even if /there . are 
few --basic changes that they are able to make .in the course 
that term. 

Note: See also suggestion No. 109 on how • to acknowledge 
mid-term feedbcick from students. 

\ • 



Limitations^ on NJse of Suggestion 

Discipline: None 
Course Level: None 
Course Size: None 
Mode: None 



Tile name: 106 
IF YOU WANT TO: 

o Know if the class is understanding you or nojL 
' o Know if the students are bored or confused 
YOU MAY WISH TO CONSIDER: 

Having students send you a telegram evalu^ation. ^ . 

A professor, of public heaLth says , "Midwa,y through the 
course^ I ask the students to write a telegram--stiictly 
limited to 20 words or less — describing the most pressing 
problem they are having in the cQurse. I 4:;^4' them that 
they can address their . telegram to me ' directly, to future 
students in the class, to :the department chairperson, or to ; 
a friend or parent. * - 

She finds the technique particularly effective if she reads 
the telegrams aloud anonymously and opens the class for dls- ' 
cuss ion. - » y ' ^. \r 

Another teacher alsq uses the^-ietter or telegram approach to 
evaluation, but aslcs that the telegrams describe the course, 
to date. ' 

Note: See also suggestion No. 109 on bow to acknowledge 
mid-term feedback from students. 



\ 



Limitations on Use of Suggestion 

Discipline: None ^ 
Course Level t None 
Course Size: None 
Mode:^ None 



File name: 107 



IF- YOU WANT TO: 

o Know 'if the class is undarstariding you or not 

o Receive feedback midway through the course 

.YOU MAY WISILTO CONSIDER: • ' 

inviting a colleague or member of tl^e TIES, staff to condtict 
an oral evaluation with your students midway t\iOugh the 
, semester and report the results back to you. 

This procedure was developed by Joseph Clark of the Univer- 
sity of Washington and has been tried out in several classes, 
at Berkeley.' -^fter introducing the vi'feitirig evaluator to 
the class ycxu must leave tKe room for 30 minutes. The 
evaluator asks the students to form small groups of five ar 
six who are then .instructed to take 10 minutes to: (1) 
select a spokesperson/recdr^ler ; (2) decide on something in 
the course they find very helpful; (3) decide on something 
they would like char\ged in the, course. 

While the groups are discussing the issues, the evaluator 
circulates among them making certain that the 'groups are. 
Working" on the task. At the end of 10, ipijiutes, the 'spok- 
esperson from each group reports the results of each group's 
discussion which the eval-ua tor * records on^the? board. After 
all' groups have reported, the evaluator summarizes what the 
overall^ consensus seems to be and asks for clarification on 
any areas in which there was disagreement between the 
. groups . ' . 

\ ^ The comments on the board are recorded-on paper to be shared 
with the instructor by the evaluator la^er that day.' 

See also suggestion Np. i09 on how to acknowledge mid-term, 
feedback from students. 



Limitations on Use of Suggestion 

Discipline: None 
Course Levelt None* 
Course Size:- Under 100-150 
Mode: None ' 
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File name: 108 , ' :i 

IE YOU WANT TO: _ ^ 

* o Know if the class is under stranding- you or not 

o ' Know if t>ie students are bored or confused 

o Get feedback on your teaching ^ . . 

o Develop a more interesting style of presentation* 

YOU MAY WISH TO CONSIDER: 

. Videotaping your class. ^ *' ^ ^ 

Several ^Berkeley professors have had • their classes video- 
taped. One zoology professor Ras had his lectures video- 
taped many times. "TftB first time was a shattering experi- 
ence," he says/ "butvit^s the most effective ^ind of feed- 
back you can get. I have^-^ound videotape invaluable, for get- 
ting rid of annoying mannerisms, for learning to vary^'the 
speed of my delivery and to put moTre expression and . greater 
clarity into my explanations." 

If you want to arrange to have your class videotaped call 
the Educational Television Office (2-2535.) . ' Guidelines for 
observing a videotape of your teaching are available in a 
short publication entitled,. Using Systematic " Live " and 
" Videotaped " oJbservation in TA Training which can be 
obtained dither frSm TIES (2^392) or from the . T61evision 
Office. 



Limitations on Use of Suggestion 
Discipline: None 

Course L'S-vil : None^ * c 

Course "Size: None 
J Mode: Lecture primarily 



File name: 109 

IF YOU WANT ^0: , . \ 

♦ 

o. Kn6w if the class ig understanding you or not 
o Know if the students are bored l&r confused • ^ 
YOU MAY WISH to' CONSlDEg: v . 

Conducting and responding to a mid-term evaluation . by stu- 
dents, ' ' . 

A critical aspect of conducting a midsemester evalus ion is 
to let students know that their comments hav,e been thought- 
fully considered. At the very next class meeting, thank the 
students for their comments and their suggestionc and give a 
brief, non-defensive account: of those^ suggestions, you can 
use this term, thos^ which must ,wait until the next time you 
teach the class and those^which you-^ither cannot or^ lor 
\ pedagogical reasons, will not chaji^e. , 

Students often make valuable suggestions or point out prob- 
lems that can be easily remedied. A^professor of forestry 
conducted a midterm evaluation in which he receivetd numerous 
complaints that he talked too fast during lectured At the 
beginning of the class period immediately following -the 
evaluation, he playfully handed out signs which said •'Slow 
down" "Go more slowly" and "Too Fast!" to students scat- 
tered around the rovom. ^During the lecture, students were 
encouraged to put up a sign when they felt he was lecturing 
too rapidly. ' - • ^ 

Of course, not all student sugg^tions can or should be fol- 
« lowed. For exampl^,, you may not/'giye.studefnts as much gui- 
dance as they would like because you are consciously trying 
to foster ' ^heir intellectual independence. The important 
thing is to acknowledge their suggestions and to give a 
brief explanation, as to why you cannot follow all of their 
suggestions. ^ . ^ . ' * 



Limitations on Use' of Suggestion . 



I>iscipline*: None 
Course Level: None 
Course Size : None 
Mode: None 
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Appendix J 



Sample Consultant's Letter 
after Consultation 
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UNIVERSm *>t^ i ALlFOnMA. BF.RKELKV 



.T£ACtlaN(ih4^^M>VATIOS 



• - - - V 




I SAKTA HAIiUAlU - tANTA CnV/ 



aKIlKICLKV, i:At IFOnNiA 94730 




Professor 
Dept. of 

Canipus 

r 

Dear Professor » 

» ■ • . ■ 

Tjiank you so much for participating in the Teaching Evalua^tion- Consul tation 
^Service. I enjoyed meetlhgA^nd talking with you about- some of the 
challenges of teaching During our* discussion you ntentiohed 

soQie useful ideas which we will incorporate as suggestions to be relayed 
to colleagues who wish to strengthen those/^orrebponding aspects of their 
courses* ^ * ' • ^" ^ 

" . ; ' ^ ■ •\ . • 

\4g explored several ideas related" to particular toprics that were of special 
concern to yotf or the students. The'first topic was controlling the 
material including your sense of pressure and lack of time; and the 
comments by several studen^^hat you covered too much material too fast 
for thein to assimilate It.^Ainong ideas we discussed wcrcf (7061) focusing 
your lectures on a few nlain points; (7095) breaking up your lectures into 
10*m1nute segments; (709r) beginning and ending your lectures with a 
suninary sta^tement; (7032) outlining your lecture on the chalkboVd as it . 
develops to serve as a *'brake*\ 



We also discussed tlj/T)bssibiVity of^your^reparimj ypur 6wh textbdok* or 
taking preliminary' steps toward ft« including preparing your own book of 
headings or (7078) a detailed course syllabus* Both of these could be 
sold to students at cost and could relieve some of the burden presently 
put'on your leetures. ' I nientlbned the possibility of applyiQQ for a grant 
to get some assistance In doing this. Pm enclosing«3 copy or our qrant , 
brochure. Ue also talked about (7077) preparing handouts and (7113) 
d)iv1djng your course material Into 3^ levels: the-8as1c, the Recommended 
and the Optional. Lecjtures ^miijht concentrate on the Basic* particularly 
since studies Indicate that/students tested on a typical college lecture 
one week after the lecture recalled only 17 per cent of the lecturers content. 

We also talked about_(4i 57) getting feedback on one's lectures by periodically 
borrowing students' notes or audlotaplng. 1 also* suggested giving the 
students a brief stretch after about |5 minutes^ 

I am enclosing an issue of Teach ing~aVlferkc4ey- which discusses several 
ways of getting to know students' names. . ' 



Continued. . . . 
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Ful 1 er-descrtptiT)ns Df some of ttie" i dea s^' we tanced about are attacfTed , 
for your consideration. These suggestions are meant 'to be stimuli for 
your own 'ideas, rather than "pat" answers, of course. Also, it should 
be noted that these suggestions are in' a "first draft"- stage of devptoD- 
ment. » - k 

Because we are still in the development stages of this project, it will 
be helpful for us to learn which ideas.- if any. seem most useful to you. 
This information will assist our understanding of any corresponding 
changes. in student ratings this Winter Quarter. Any suggestions you 
might have for improving our interviewing procedures would also b-* 
most welcome. 

I will be contacting you in February about the best time to administer 
Winter 1981 evaluations in your course.. Again, many thanks for your 
i.nterest and participation. If. after reviewing the materials, you have 
any questions or comments, jyst give me a call at 2-6392 or .2-1811. 
I look foTward to hearing from you early in Winter Quarter about coming 
to. observe one of your lectures. * 

• ' ■ . 'I '■ 

• . Best. wishes, 

■ -■.^1. 

Robert C- Wilson 
Director 

RCW:mb 

Enclosures . ' , 

7/// 7C.7S' ,^IS7 
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Table K-1 



Rank and Discipline of Client Faculty 



Rank/ 



Discipline 



Lecturer Assistant Associate Professor Total Sample 
Professor Professor ^ % 



Humanities 

Social 
Sciences 

Physical. 
Sciences ' 

a. 

Biological 
Sciances 



0 

1 

0 

1 



Interdisciplinary 0 

Total 2 

Sample Percent ^ 4% 

Campua Percent 10% 



2 
1 

* 2 
1 
2 
8 

18%. 
1^% 



2 

1 * 
-9 
7 

0 

19 
42% / 
16% _ 



1 
2 

1 
6 

/ 

/ 16 
36% 
56% 



5 
5 



11% 
11% 



12 , ^ ^7% 



15 
8 
45 



33% 
17% 



ERIC 



104 



Table K-2 



Class Size acrd Xliyisioo 'q£ ClieDts'' Classes 



Divisidn 



Size 
1-35 



36-100 

.101 or 
larder 

Total - ' 

^anFle % 

Campus % 



Lower 



. 5 
. . 4 

11 

<^ 24% 
11% 



■ y 

11. 

15 ' 

3 . 

it. 

29 

63%. 
46% 



Qjraduste 



6 
135?" 
43% 



Total 
17 



46 



Note: Hean cLass size eouals 61* 



Appendix tj^ckground Documents 



This appendix includes the 1969 "Instructions 
to Appointment arfd Promotion Committees" 
Issued by President Charles J. Hitch, requiring 
for the first time the submission of evalua- 
tions of the candidate .soWcited from students, 
concerning the candidate's teaching effectiveness. 
It also includes 'a 1970 statement of President 
Hitch emphasfizing the requirement that student 
evaluations be included in^recommendattc' for 
promotion. 
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CHANCELLORS: 



\ 



Attached herewith you will find an official copy-of the newly 
revised Instructions to Appointment and Promotion Committees, 
This version isa^ieclive immediately. It supersedes the version 
which appears in the Mjy 1968 edition of the Faculty Handbook, • 
and which v/as issued by the Presideo^ on December *31, 1965, 



As.vou know, the pi^ocess.xrf'^revision h*-s L'lvolved lengthv 
cprisultation with-Acstdemic Senate corAmi't/tees, both at ^ 
campus and Universitywide levels,, discussions in the 
Gouneil of Chancellors, and the efforts of a joint ad hoc 
faculty - administrative committee, 

The'se Instructions play a very important role in the maintenance 
of the quality of th§- University. I believe that some significant 
improvements. have been made m the Instructions, I know they 
will continue to serve us well. 



Charles J, Hitch 

cc: Members of the Academic Council 

'Members of tlxe University Committee on 
. Budget and Interdivisional Relations- 



BEST CGPY AVAILABLE 
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Off ice of ^he Presldent<^ 
August 29, rj69 



INSTRUCTIORS TO APPOINTMENT A-ND PRCMOTMM COMMITTEES 



A. Purpose and Responsibility of the Review Cpimlrtees 



The quality of *the faculty of the University ofx^llfornia Is maintained 
primarily thi^ough objective and thorough appralsal>vl^ competent faculty 
inetsberSy of each candidate for. appointment or promo tlon^^-<.fi^ponsibi 11 ty 
for this apipralsal falls largely upon the revi'ev comalctei^ nominated by 
the Cbmalttee on Budget azid Interdepartmental Relations and a^pointe<f by 
the Chancellor or his designated representative. It Is^the duty of these 
committees to ascertain the present fitness of each candidate and the 
likelihood of his pursuing a productive career. In judging the sitness 
of the candidate it Is appropriate to consider his professional integrity 
as evidenced by his performance cof his duties*. (A useful guide for such 
conslderat;flon is furnished by the Statement otx Professional Ethics issued 
by- the American Association of University Professors. A copy ox thks 
Statement Is appended to, theserlnstructi!^|is for purposes .of reference.) 
Implied in -the committee's responsibility for building and malntaliiing a 
faculty .of'^the highest excelleifVe is also, a "Responsibility to the qardi* 
date for Just recognition and encouragement orvacMevement. 





Maintenance of the CoinmlfC tee's Effectiveness 

(1) THE MEMBSRSHljP, DELI3ERAXI0NS , ANT) RECOMIlENDAT^XpNS Oc THE [IEVIE; 
COMMITTEE ARE STRICTljY' CONTIDETtlAL. The chairman of. ak appointme it or 
promotion committee sHould remind members of the commlcteW^ and otners 

fldenftlal 

. _ ^ . nglng*for 

all written or oral j^oinnunlcatlbns; and when recommendiitlattS~^9Vth jsupport-- 
Ing documents have been forwarded, all copies ,,ox-^rellmlnary drai 
:.be destroyed. / * 



:s should 



\ (2) The whole system ofrevlew by appointment and promotion committees 
(iepends for its ef fect^vetiess upon each committee's prompt attention to 
its assignment ^n^l--l:^ conduct of the review with all possible dispatch; 
cbQslstent wjrth judicious and thorough consideration of the case. ^ \ 

[S) The Chairman of tiie rsview committee has the responsib^lllty of 
making sure that each member^ of the committee has read and ^understands 
these Instructions, v. • - - 

C. Procedure 

(1) General - Recommendations for appointments and promotions normally 
originate with the Department Chairman. His letter of recommendation 
should proylde a comprehensive assessment of the candldatej-S^-qtHfllf ications 
together with detailed evidence to supj^rt this evaluatlmi. The letter 
should also present a repott of the Department Chairman s consultation 
with the members, of his Department, including any dissenting opinions. In 
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addition to his letter of recommendation, the Department ^Cbairmn is 
'expected to assemble and submit to the Chancellor an up-to-date biog 
and bibliography, together wTth copies of research -publications ar o 
scholarly or creative work. - • * ,r 

(i) AgpQintments - The Department Chairman shy^uid include in his 
documelitation opinions from colleagues in :6th'e'r institutions where t 
nomine^ has served and froc\ other qualified persons having firpSthanfi 
knowledge of the nominee's attainments. ^Extramural opinions are inp 
tivc in the case- of proposed appointnients -to tenure status of person 
out^id^ the University. ^ 

(3)\ Promotions - Promotions are based on n^etit; they are not ajit 
Achievement, 'as it is demonstrated/ should be rewarded by promotion, 
notions 'to tenure positions should be based on [consideration of comp 
work 'in a man's cvn field or in closely related fields. The Departtr 
^nd the review committee should consider how the* candidate stands .in 
relation to other people in his field outside the University who mig 
considered alternative candidates for the position. It is;^also recc 
that the Department Chairman supplement the opinions of his colleagu 
within qhe Department by letters from distinguished 'extramural irvfor 

• (A) Assessment of Evidence - The review comnittee/shall assess t 
adequacy of the evidence submitted. If in the cormittee's judgr.ent 
evidence is insufficient to re^h a clear reconcendation, the comic 
chairman, through the Chancellor , shall request amplif iqatio.n V In e 
^case all obtainable evidence shall be carefully considered. 

If, atcordiag"-tQ^^l obtainable evidence, the candidyite f aiSs- to 
meet the criteria set^^f^rth^Jji Section d. below, the committee shoul 
recommend against appointment^T^^pj^omotion. If, on the ocher hand, 
is evidence o,f. unusual achievement, arl^K^cceptional promise of conti 
growth tjie committee should- not hesitate to'^^Btv^orse a recomendation 
accelerated advancement. . . ^ ^ 

D. Criteria for Appointment and Promotion > . 



The review committee shall judge the candidate with respect to^'the p 
rank atid duties, considering the record of his performance in (a) te 
(b).. research or other creative' work, '(c) professional activity, and 
university and public service. In evaluating the candidate's qualii 
tions within these ar^as, the review committee shall exercise reasor 
flexibility, balancing, wherc^ the cage requires, heavier commitments 
responsibilities in one area against ^lighter commitments and respons 
in another. The review committee muH:. judge whether the candidate i 
engaging in a program of work that is both sound and productive^- As 
University enters ,n^w fields of endeavor and refocuses its ongoing 
activities, cases will arise in which the ptoper work^of faculty m^ 
departs markedly from established acade?ni/^ patterns . In such cases 



.Che revJLew committees must take exceptional care to apply the criteria i 
suff/lclent flexibility. However., flexibility does not encfail a relaxat: 
of lilgh standards. Superior intellectual attainment, as evidenced both 
in^ teaching and in research or other creative achievement, is an in- 
dispensable qualification fdr^appointment or promotion to tenure positic 
Insistence upon this standard for hol'ders of the* professorship is > 
necessary for maintenance o| the quality* of the University as an ins tin 
dedicated . to 't^e discovery and transmission of knowledge. 

The crj.teria qet forth below are intendei^ to. setVe as a. guide in judgia{ 
the candidate, hot to set boundaries to the 'elements of performance that 
may be considered. 

(1) Teaching - Effective teaching is an essential criteripn to 
appointment, or advancement. Under no circumstances will a tenure, 
commitment be made .unless^ there is clear documentation of ability and' 
dili-gence in the teaching role« ' In judging the effectiveness of a 
candldate''s teaching, the committee should consider such points , as ^hT^ 
^following: the candidate's command of fils subject; his continuous 
growth in his field; hls*ablllty to organize his material and to pre* 
sent it with force and logic; Als capacity to awdken in students an 
awareness of^ the relationship of his* subject to other fields of knowledj 
his , grasp. of general objectives; th^ spirit and enthusiasm which vicali: 
his learning and teaching; his ability to arouse curiosity 'in beginning 
students and to stimulate advanced students to creative work; his persct 
attributes as they affect his teaching and his students; the extent 
and skill of his participation in the general guida nce and .advisirig of 
students. The committee shoxild pay clue attentibrTto the variety of 
demands placed on^ Instructors by the types of teaching called for in 
various. dlsclpllnles and at. various levels, and should judge the total 
performance of the candidate with proper reference to his assigned teacr 
respbnslbilltdes. The committee should clearly Indicate. the sources of 
evidence on which its appraisal of teaching competence has been based. 
In those exceptional cases where no such evidence is available, the 
candidate's potentialities as a teacher may be indicated in closely 
analogous activities. 

/ . . " * " ^ ' ■ ■ ■ 

/ It jLs the responsibility of the department Chairman to submit 
meaningful statements, accompanied \y evi^dence, including evaluations ol 
the candidate solicited from students, concerning the candidate's teachJ 
effectiveness at lower-division, upper-division, and graduate levels of 
Instrii^ctlon. If such information is not included in the letter of 
recomzMndatlon, it is the review committee chairman's responsibility to 
request it, through the Chancellor* 

\ No single set of satisfactory criteria can be prescribed; howevc 
among significant types of evidence of teaching effectiveness- are the 
following: (1) Opinions of other ipembers of the candidate's Department < 
particularly if based on class visitations, on attendance at public lec; 
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or lectures before professional societies j given by^he candidace, c 
on the candidate's. results in courses prdirequisi'te to -chose of the 
informant. (2) Opinions of students.__C3) Opinions of graduates vh 
< have achieved notable, prof^ssionai--8uc^ss since leaving the Univei 
(4) Number and-q^aliber of studfents g>rf^^d in research liy the candic 
oT and of those att^cted to, the cammxS by his repute as a leader. (! 
Development of new and ef fective/cechnlques of. instruction. 

(2)- Research and Creailve Work - Evidence of a productive and 
creative mind should be sought in the candidate's published resear( 
or recognized artistic production in original architectural or engi 
ing designs,, or the like. \. ^^^^ 

Publications in research and other creative accomplishment 
be evaluated, not merely enifinerated. There should be evidence thai 
candidate is continuously and effectively engaged in creative acti^ 
high quality, and signif icancp. Work in progress sjioruld be assesse< 
ever possible. When "t>ubli3hed work in joint authorship (or other i 
of joint effort) is presented as evidence It is the responsibility 
Department Chairman to ostablish a^ clearly as possible the role o: 
/candidate in the joint effort. It should be recognized that specL 
' casis of collaboration occur in^the T>er forming arts apd that the a 
tion of a particular collaborator- may tfot be readily discernible at 
by those viewing the finished -work. When. the candidate is such a i 
orator it is the responsibility of the Department Chairman to make 
-^—^eparat'*- evaluation of the candidate'? contribution and to provide 
oplnior s based ^pn observation 'of the work while in progress. Acco^ 
should 1>e taken of ' the type and quality of creative activity norma: 
^exp^cted in the candidate's field. Appraisals of publications, or ( 

* works in the scholarly and critical literature provide important t 

Textbooksi reports, circulars, andfl similar publications n 
considered evidence of teaching ability or public service, oV do^t 
by candidates In the professional school faculties to the proffessi 
literature, the advancement of professional practice or of pro/ess 
education, should be judged creative work when they present new id 
or incorporate scholarly research. 

f ■ ' " ■ . ' 

In certain fields such as art, architecture, dance, music 
ture,.and drama, distinguished creation should, receive considerati 
equivalent to that accorded to diisiClnction attained In research. 

* evaluating artist^.c creativity, an^ attempt should be made to defin 
candidate's merit In the light pi such criteria as originality, sc 

* hess, and depth of creative expression. It should be recognized t 
music, drama, and dance,' distinjguished performance, including cond 
and directing. Is evidence of ^' candidate's creativity* 

(3) Professional Competence and Activltyt - In certain positio 
the professional schools and colleges, such as architecture, busir 
'administration, dentistry, engineering, law, medicine, etc. , a 
dciMnstrated^Mtefincti^ in "the special competences appropriate to 



field apd lis characceriscip actlvlcles should be recognized as, ^ 
criterion for apptolncnent or pxomoclon. The candidate's prof essl^onal 
actlvlcles should be scrutinized for evidence of achievement and leader* 
ship In. the field and of demonstrated progresslyeness In the development' 
or utilization of new approaches and techniques for the solution of 
professional problems*^ It Is^the responsibility of the Department 
Chairman to provide evidence that the .posl.tion'^ in question is of the 
type described a^ove and that the candidate is qualified to fill it. ! , 

(4) University and Public Service .-.The faculty plays an Important 
role in the administration of xhe University and in the formulation 
of, its pqXicies. Recognition should therefore be given .jto scholars 
who prove themselves to be ^ble adndnistrators and who participate 
effectively and Imaginatively in faculty government and the formulation 
of departmental, college, and University policies. Services by membe;:s 
of 'the faculty to the community, state,, ^and nation, both in their, -special 
capacities as scholars and in areas beyond those special capacities 
vhen«che work done is .at a sufficiently high level and of sufficiently' 
high quality, should likewise b'e recognized as evidence for promotion. J 
Similarly, contributions to student welfare through service, on student* 
faculty committees and as adviser to student organizations should.be - 
recognized as evidence. 

■ . #■ " 

E. The Report • *, * 

(1) The report'^of the review committee forms the basis for further 
review by the Budget Committee and for action by the Chancellor and by, 
the President. Consequently, it should include an appraisal of all 
significant evidence, favora ble and unfavo rable.^ It should be specific 
and analytical and shoul<rl!ticl4ide the r eview^ommi t tee ! s evaluation of 
the candidate with resp^ect to each of the (fualificat loos specif led 

above ^ It should be adequately documented by reference to the supporting ' 
material. ■ » ■ " ' 

(2) The review committee has the* responsibility of making an uneq^uivqca.' 
recommendation; No member should subscribe to the^ report. -if it *does not 
represent his Judgment. If the "^committee cannot come to a unanimous 
decision', the, division of the committee and 'the reason, therefor should 

1>e communicated either in the body of. the report^'or in separate concurring 
or dissenting statements by individual members, - submitted with the ma'in 
report and with the cognizance of fthe other committee members. 

, Appended for reference on the following page is the 
AAUP Statement on Professional "Ethics referred to in 
the first section of these instructions. 
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' Aaierlcan Association of University Professrors Bulletlii ' . 

A. • Vol. 52, p* 290-291, 1966 ' . 

(Reprinted) Vol. 55, p. 86-87 ,"^69 

Statement on Professional Ethics • ^ 
(Endorsed by the Flf ty-'Second Annual Meeting) 

¥.;,'•'■ 

The Statement • ' 

: • • ^ , ■ . . , "v 

The professor, guided ^y a .deep cionvlction of the, worth and dfgnlty of 
the advancement ^f knowledge, recojgnlzes the special responsibilities placed .^^ 
upon him. His primary responsibility to His sybject is to seek and cc state 
the truth as he sees it. To this end he devotes' his energies to developing 
and Improving ^Is scholarly cpmpetence. He accept«^ the obligation to. exercise 
crlticdl^ self -disolpline and judgment in uslngg extending,' and transmitting 
knowledge*. He*practlces ln.tellectual honesty/ Although he may follow subsidiary 
Interests, these interests must never seriously hamper or compromise his 'free- 
dom of ln'qu4.l;y^ ^ ' 

II. .Ka a teacher, "^e professor encourages^ the free pursuit of learning in, 
his students. He holds before them the best scholarly standards of his disciplii] 
He demonArates respect for the student as an Individual, and adheres to his 
proper role as intellectual guide and counselc:^,. He makes every reasonable 
effort to foster honest academic conduct and to assure that his evaluation of 
students reflects their true merit. He respects the confidential nature of 
the relationship between professor and student. He Avoids any exploitation 
of stu4ents for kis private advantage and acknowledges significant assistance 
from them. He protects their academic freedom. 

III. As a colleague, the professor has obligations that derive from common 
membership in the community of scholars.. He respects and defends the free 
Inquiry of his associates. In the exchange of .criticism and ideas he shows due 
respect for the opinions of others. He acknowledgeis his academic debts and 
strives to be objective in his professional. Judgment of colleagues. He accepts 
his share of faculty responsibilities for the governance of hii^ institution. 

;IV. As a member of his institution, the professor seeks above alX to be 
Sfi effective teacher and scholar. Althoug}^he observes the stated regulations 
qf the institution, -provided they do not contrav^e academic freedom, he 
maintains his right to criticize and seek revision. He determines the amoimt ^ 
and 'character of. the work he does outside his institution '/with due regard to 
his. paramount responsibilities within it. Uhen considering the interruption 
or termination of his service, he recogi^izes the effect of his decisioir upon 
the program of the institution and gj^ves dufe notice of his intention^. 

V. As a member of his coi^punity, the professor has the rights and obligation'^ 
of any citizen. He measures ihe urgency of these 'Obligations in the light of 
his responsibilities to his .subject, to his students, to his professior\^ and 
to his institution. Whea he speaks or acts as a private person he avoids 
creating, the impression that he speaks pr acts for his college or university. 
As a citizen engaged in a profession that depends upon freedom for its health 
and integrity, the profe*ssqr has a particular obligation to promote con- 
ditions of free inquiry and to filrther public understanding of . academic ff-eedom. 
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CEAJJCSLLORS: .. t • •. - 

On Thursday,/ November 12, I ^uaa holding press conferences^M^San / . 
Francisco in:tke morning and in Los Angeles in the afternoon to release 
my statement on Improvemerit of Under^^duate^Teaching and Us.e of - 
Lostructiooal Resources. The, statement 'Arill also be carried in full in ; 
this week.^s University Bulletin. * ^ 

I want you to have advance notice of this release* because I thihk it \7ill 
create great interest both inside and outside"* gf th^ University community. 
You will recall ouz: several discussions abbut'faculty effor^'^aSJ oi^ut^;^ 
and the need for improvement of undergraduate teathingi v/rth par^cuiar 
emphasis on fres^'iinen and sophomores. I consider this statement ar.gthe- 

and important step along the road to general improvement of these ar^as. 

• - ■ • ■ - " . 

I ask that you accomplish the purposes of ttis statement as quickly and 
fully as possible, 

€^-^ ' ' \ • 

Charles J. Hitch ' " • 

cc: Administrative Officers, Office of the President 

Pi^incipai Officers of The Regents . 
' Members of j^ei Academic Council 
Student Body Presi dents 
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President Hitch's StatWnt on Improve'iBent of Undergraduate Teaching 



The Univc'sity of California haWacuUies which i'nclude'scholars ar.ong the' 
most eminent in the world.' It provides graduate and professional education 

- of high (qualify. It renders great service to this State and to the Maticr. 
During, the past two deca-des, in response to national needs' for greatly 
increased numbers' of qolleg's and university teachers and professional schccl 
graduates, and for "greatly expanded training and 'research in science and 

• allied f.i-elds,. the University'accelerated the development of fts capabilitis 
in graduate and professional education and in research, so that in these ars 
it hagjwell justified the'trust placed in it by the people of California. -I 
must and will continue to justi/y that trust., = / 

But the University of California has another gre^t responsibility: it ir.ust 
meet^tjje educatiot;al needs of able 4[indergraduate students. Here the Univer- 
sity as a whole is nottloing as well as it could and should be doing, 
although there are some' notable examples of interest in and devotion to 
undsrgraduata teacl-.ip.g v/fthin the University. . Like -QSt lar.ga insti tutio:'5; 
' which, offer strong programs of graduate* instruction, however , the Universjt:, 
now needs to ^ive renewed attention to: the quality of its programs for ( 
undergraduates. There must be. greater corrjni tiiient of faculty of all ranks tc 
the' instruction of undergraduate students. There must be dater^'.ined' effort* 
throughout the Univ.ersity to live up, to this commitment through a variety o1 
positive actions. -Ml/.. ' ] 

I am asking each Chancellor to-dsvelop^a^P^^n "^f action appropriate to his 
. qampus' for strengthening or reaffirming tRr"*caHBi tment to undergraduate i 
education, including the steps to be. taken to carry out the-^plan. The, 
precise nature of the plans may be expected -to vary from campus to campus 
and even from department to depa^\tmsnt vn'thin the same campus*? but each 
campus must act to ensure that undergraduate students receive education of 
the highest possible quality. Thevteaching' program must significantly 
involve faculty of all ranks in' instruction at, all levels, including the 
Jower division (I recognize that in some parts of the University this is 
already accepted practice). 

I. am asking the Chancellors to submit their preliminary pUns. I^r reviev/ by 
January 22, 1971. Completed plans must be approved. and put into effect by 
the opehing of the Fall Quarter, 1971. 

Strengthening our commitment to undergraduate instruction cannot, be acccrip- 
lished by University-wide formul>as or by .mere quantitative standards. Ther 
are "certain guidelines, however, which I expect to' be followed. 

» . , ' . ■ .« 

' 1. Efforts must be directed toward curricular reforrr.s intended to 
*^ " assure that course offerings and schedules are optimally desigrsd 

to meet the educational needs, of students. It is the. responsi- - 
' bility of each. -department chairman or equivalent officer, with . 
thesjarticipation of his faculty and review by the dean and ir.e . 
Appropriate. Senate cbrnmittees, to assure fhat the curriculum 
under his jurisdiction meets this standard- and that it is subject 
to constant review and' evaluation. (This responsibility is set , 



forth in the University's policy statement on "Duties of Depart- " 
ment Chairmen" and in ths guidelines for the administrative ^ 
supervision- of academic proarams which ware issued by my Office 
In September, 1970.) _ . 

" ■ * 
Cha.irmen' are to a^srg« teaching responsibili ties in such a manner 
as to ensure substantial invbTvemlht of 'faculty of all ranks in « 
instructfon at all levels, including the lov/er division. .Respcnsi 
hi li ties of faculty members Avhich are related to the instructional 
.program, such as' scheduled instruciicnalVsessions with students 
and the holding of offiCjp hoursVmd*t of course, be carried out as 
announced, " ^ # . v • . . 




There must be the opportunity for^fevery^reshman to 
during at least' one quartgr-of "the academic year, irfV^mal 1-^oup 
class directly^WygJrt-^' a faculty member in one of the professorial 

ranks. • ? - .^'^ \ ' ^ 

Evaluation and documentation of teaching performance must be sub- 
stantially improved, in accordance v/ith the revised "Instructions 
to Appointment and Pi«omo^tion Committees" issued in August, 1969.^ 
f stron-gly. recommend that the foTl owing /suggestions .be considerecf, ^ 
artd I would welcome additional^ suggestions from the campuses: 

a. ^Departmental or college teams, reporting to the dean through^ 

department chairmen, should be established to evaluate the^ 
quality of teaching of faculty meTnbers at. all. levels, giving 
particular attention to faculty being considered for promo- 
tion to tenure -rank. Methods of evaluation might include^such 
practices as class vlsitatit^n, study of teaching snat-erials 
such as reading lists, term 'paper and problem assignments, 
leQture notes, and examinations, ancl inieryiews with, current 
and former students; the metfjods judged appropriate will vary 
from department to departmen't. — \. 

b. Organized j^forts for the evaluation of teachers by students 
- should be Wncouraged. The "Instructions to Appoiritment and 

Promotion Committees" require that student evaluations be 
included in recommenda-tions for promotion?; organized efforts 
to--secure such evaluations would facilitate compliance vn'th . 
this requirement. 

In this, connection, I am instructing t)iat the annual bio-bibl iograph 
veal statement form which is distributed , by my off tee be a^nanded - 
to provide opportunity for faculty .members to include, brief descrip- 
tions of any systematic efforts to imi>r/)ve instruction in which * 
they harve been engaged during the year. 

Chancellors should institute detailed studies of how their carc-s 
teaching resources are being used —^hy department, by level of 
instruction, and by faculty rank — as a basis for effective actipn 
to improve. .the quaVjty of undergraduate education. 

''J - 
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.Chancellors should* allocate their limited resources in ways that 
v<in make a substantial permanent conlhitment to improving the • 
quality'of education. They should encourage continuing instruc- 
tional experimentation along every promising line, even though 
not all experiments can be expected to succeed. One way pf 
\offering such encouragement will be to provide matching funds 
froni campus resources for the special Regents '.Undergraduate In- 
stfuctional Improvement 6^ants^, to be available in 1971-72. 

The task here set for the University is worthy, of our^best tJlfints* and 
collective efforts. , I am confident that this endeavor will have the suppor 
of all secto^rs of the University community. ' . - 
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